-- Logs begin at Tue 2022-07-12 17:26:16 UTC, end at Tue 2022-07-12 18:37:39 UTC. -- Jul 12 18:01:17.701760 dv-cinder-844881-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 18:01:17.713897 dv-cinder-844881-1-smb devstack@keystone.service[80570]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 18:01:17.716473 dv-cinder-844881-1-smb devstack@keystone.service[80570]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 18:01:17 2022] *** Jul 12 18:01:17.716622 dv-cinder-844881-1-smb devstack@keystone.service[80570]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 18:01:17.716736 dv-cinder-844881-1-smb devstack@keystone.service[80570]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 18:01:17.716840 dv-cinder-844881-1-smb devstack@keystone.service[80570]: nodename: dv-cinder-844881-1-smb Jul 12 18:01:17.716942 dv-cinder-844881-1-smb devstack@keystone.service[80570]: machine: x86_64 Jul 12 18:01:17.717052 dv-cinder-844881-1-smb devstack@keystone.service[80570]: clock source: unix Jul 12 18:01:17.717153 dv-cinder-844881-1-smb devstack@keystone.service[80570]: pcre jit disabled Jul 12 18:01:17.717259 dv-cinder-844881-1-smb devstack@keystone.service[80570]: detected number of CPU cores: 4 Jul 12 18:01:17.717360 dv-cinder-844881-1-smb devstack@keystone.service[80570]: current working directory: / Jul 12 18:01:17.717456 dv-cinder-844881-1-smb devstack@keystone.service[80570]: detected binary path: /usr/bin/uwsgi-core Jul 12 18:01:17.717563 dv-cinder-844881-1-smb devstack@keystone.service[80570]: your processes number limit is 47680 Jul 12 18:01:17.717667 dv-cinder-844881-1-smb devstack@keystone.service[80570]: your memory page size is 4096 bytes Jul 12 18:01:17.717770 dv-cinder-844881-1-smb devstack@keystone.service[80570]: detected max file descriptor number: 2048 Jul 12 18:01:17.717881 dv-cinder-844881-1-smb devstack@keystone.service[80570]: lock engine: pthread robust mutexes Jul 12 18:01:17.718135 dv-cinder-844881-1-smb devstack@keystone.service[80570]: thunder lock: enabled Jul 12 18:01:17.718424 dv-cinder-844881-1-smb devstack@keystone.service[80570]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 18:01:17.718611 dv-cinder-844881-1-smb devstack@keystone.service[80570]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 18:01:17.762768 dv-cinder-844881-1-smb devstack@keystone.service[80570]: Python main interpreter initialized at 0x55ce48e319c0 Jul 12 18:01:17.762768 dv-cinder-844881-1-smb devstack@keystone.service[80570]: python threads support enabled Jul 12 18:01:17.762768 dv-cinder-844881-1-smb devstack@keystone.service[80570]: your server socket listen backlog is limited to 100 connections Jul 12 18:01:17.762768 dv-cinder-844881-1-smb devstack@keystone.service[80570]: your mercy for graceful operations on workers is 90 seconds Jul 12 18:01:17.763108 dv-cinder-844881-1-smb devstack@keystone.service[80570]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 18:01:17.763184 dv-cinder-844881-1-smb devstack@keystone.service[80570]: *** Operational MODE: preforking *** Jul 12 18:01:17.763440 dv-cinder-844881-1-smb devstack@keystone.service[80570]: *** uWSGI is running in multiple interpreter mode *** Jul 12 18:01:17.763440 dv-cinder-844881-1-smb devstack@keystone.service[80570]: spawned uWSGI master process (pid: 80570) Jul 12 18:01:17.763631 dv-cinder-844881-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 12 18:01:17.764380 dv-cinder-844881-1-smb devstack@keystone.service[80570]: spawned uWSGI worker 1 (pid: 80581, cores: 1) Jul 12 18:01:17.768152 dv-cinder-844881-1-smb devstack@keystone.service[80570]: spawned uWSGI worker 2 (pid: 80582, cores: 1) Jul 12 18:01:17.768152 dv-cinder-844881-1-smb devstack@keystone.service[80570]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 18:01:23.237900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:01:23.237900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: from cryptography.utils import int_from_bytes Jul 12 18:01:23.238641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:01:23.238641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: from cryptography.utils import int_from_bytes Jul 12 18:01:23.239357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:01:23.239357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 12 18:01:23.239769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 18:01:23.239769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 12 18:01:23.287686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:01:23.287894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:01:23.288135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] command line args: [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:01:23.288283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 18:01:23.288428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:01:23.288513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 18:01:23.288631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ================================================================================ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:01:23.288710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] command line args: [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 18:01:23.288906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] admin_token = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.288992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 18:01:23.289187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ================================================================================ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 18:01:23.289270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] config_dir = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] config_source = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] config_dir = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] debug = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.289975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] config_source = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] debug = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.290889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.291965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_config_append = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_dir = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_config_append = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.292913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_dir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.293940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.294938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.295996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] publish_errors = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.296944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] publish_errors = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] standard_threads = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.297948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298062 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] standard_threads = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] use_journal = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] use_json = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] use_stderr = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] use_syslog = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.298990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] use_journal = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] use_json = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.299461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] use_stderr = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] use_syslog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.299847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 18:01:23.299922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.300941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.301093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.301182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.301919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.301998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.302967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303365 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.303923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304365 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.304917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.305908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.306985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.307933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.308986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.309922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.310984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.311987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.312924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.313993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.314932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.315956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.316902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.317952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.318979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.319904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.320906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.321863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.322941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.323968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.external = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.324956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.external = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.password = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.325936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] auth.token = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.password = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.326889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.token = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.327983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.328970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.329945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.330930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.331992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.332168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.332267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.332941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.333984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.334955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.335923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.336898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.337998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.338937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.339996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.340942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.341887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.342846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.343955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.344990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.345932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.346884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.347964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.348041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.348757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.348833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.349948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.350952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.351899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.352885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.353977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.354930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.355947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.356909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.357863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.358979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] role.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] role.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] role.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.359996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] role.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.360996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.361942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.362950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.363962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.364961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.365982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.366927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.367881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.368850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.369974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.370926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.371961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.372967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.373901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.374984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375062 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.375998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80582) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:01:23.376670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.376880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.377117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 18:01:23.377291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 18:01:23.407341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.407568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.407791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.407874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.408059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.408329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.417072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.417513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.444966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.445127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.445227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.445363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.586795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.588191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.635321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.635552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.635638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.635863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.700863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.701950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.702031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.702174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.728393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.728624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.728856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.728942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.729931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.730143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.741144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.741661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.753813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.754008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.754098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.754240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.754853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.755855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80582) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 18:01:23.773366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.773582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:01:23.773914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.774126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:01:23.774258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.774337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:01:23.774603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.774683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.774867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.774950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 18:01:23.775129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.775209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.775388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.775466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.775646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.775903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.786330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.786611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.786886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.787021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.787173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.787314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.787493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.787772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.795672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.796282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.798972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.799259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.799545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.799776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.799915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.800882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.801938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.802183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.802447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.828588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.830220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.830371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.830507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.831859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.832157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.836363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.836647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.836975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.839382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.839662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.839941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.844357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.844640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.847308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.847589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.849139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.849428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.849712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.850000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.850278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.850552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.850823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.851092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.852882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.853153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.853431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.853710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.853985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.854257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.854523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.854789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.869713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.869992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.873893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.874171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.874844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.878560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.878861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.879092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.883406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.883701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.884582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.888198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.888842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.891828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.892138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.892446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.892526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.892742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.893021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.893299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.896693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.896987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.897276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.897565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.897849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.898126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.912849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.913138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.913408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.913682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.917250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.917530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.917798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.918061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.921855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.923554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.923832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.925918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.927070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.927350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.927629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.927745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.927908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.928022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.928223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.931276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.931555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.931834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.932146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.932466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.941484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.942294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.942579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.942869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.943157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.943441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.943716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.946110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.946387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.946668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.946945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.947218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.947502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.947772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.963502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.966818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.967382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.970140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.970650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.971738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.973567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.973852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.973974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.974141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.979696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.981539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.981863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.982150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.982641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.984351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.987596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.987892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.988209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.988499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.989508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.991102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.994299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.994591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.994872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.995145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.997734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:23.998025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:23.998308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.004789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:24.005080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.005355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.006693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:24.006975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.007258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.007534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.007810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.008093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.008396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.008690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.009068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.009343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.009618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.009882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.010149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.010427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.013123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80582) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 18:01:24.013398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.013674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.013947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.014217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.014501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.014778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.015050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.015420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.015689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.015958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.016239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.016513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.016789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80582) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 18:01:24.048983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ce48e319c0 pid: 80581 (default app) Jul 12 18:01:24.052960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fe35-5604-480a-a66a-a1d37d1a8cca None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:24.053255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fe35-5604-480a-a66a-a1d37d1a8cca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:24.053539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496fe35-5604-480a-a66a-a1d37d1a8cca None None] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:24.055406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55ce48e319c0 pid: 80582 (default app) Jul 12 18:01:24.057777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Tue Jul 12 18:01:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:32.217053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:32.217562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:32.217562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:32.221825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:01:32.227489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:32.227883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:32.228047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:32.297250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: INFO dbcounter [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] Registered counter for database keystone Jul 12 18:01:32.318877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG oslo_db.sqlalchemy.engines [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:01:32.324977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writer thread running {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:01:32.498816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80581) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:01:32.499158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80581) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:01:32.553367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:32.554978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:32.674394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 18:01:32.884176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:32.954759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: INFO dbcounter [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] Registered counter for database keystone Jul 12 18:01:32.974235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG oslo_db.sqlalchemy.engines [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80582) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 18:01:32.980349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writer thread running {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 18:01:33.097748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779789b8-866e-4ad9-8328-a8939f433fda None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:33.101940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:33.102605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:33.102889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:33.103165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:33.111112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:33.163138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING keystone.common.rbac_enforcer.enforcer [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:01:33.163479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e564145d-4131-4639-bf35-fe3aa3db2e4e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:33.173160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Jul 12 18:01:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:01:33.179602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:33.194757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca29c8-50f6-459d-ad67-7f19d2e6d7b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:33.199205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:33.200353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:33.200642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:33.200919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] PATH_INFO: `/v3/projects/71b4b41640174f02914b235b985edf53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:33.204959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] RBAC: Authorizing `identity:get_project(project_id=71b4b41640174f02914b235b985edf53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:33.255811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 18:01:33.256399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a81c8f-183d-4ec9-a821-cc749211a084 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:33.260724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Tue Jul 12 18:01:33 2022] GET /identity/v3/projects/71b4b41640174f02914b235b985edf53 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:35.272396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c6c4-8bdc-4c9a-aa4e-c0d50b929898 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:35.272919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c6c4-8bdc-4c9a-aa4e-c0d50b929898 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:35.272919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25c6c4-8bdc-4c9a-aa4e-c0d50b929898 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:35.277034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:35.282417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:35.282791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:35.282979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:35.302648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:35.304175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:35.311857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 18:01:35.334302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25c6c4-8bdc-4c9a-aa4e-c0d50b929898 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:35.346229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25c6c4-8bdc-4c9a-aa4e-c0d50b929898 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:35.351091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:35.351725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:35.352018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:35.352337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:35.360141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:35.361912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418256ed-b1db-416c-b68b-09547dc90c22 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:35.370559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Tue Jul 12 18:01:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:01:35.375548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:35.384392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50339e97-fa00-43ed-a1a3-b88ae05706dd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:35.388634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:35.389475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:35.389758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:35.390033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:35.391406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:35.393246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbf656-aafe-416c-8884-23c99d196739 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:35.395294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Tue Jul 12 18:01:35 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:37.466278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec435d-4566-40c6-b98b-90fa15ef1799 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.466786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec435d-4566-40c6-b98b-90fa15ef1799 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.466896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddec435d-4566-40c6-b98b-90fa15ef1799 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.468391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:37.473735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.474123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.474411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.491248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:37.492444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:37.497327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525ff-e8bc-4160-8294-eba2d3a5327a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.497682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525ff-e8bc-4160-8294-eba2d3a5327a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.497959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b525ff-e8bc-4160-8294-eba2d3a5327a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.499286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:01:37.504306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.504600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.504883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.544483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG passlib.handlers.bcrypt [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80582) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 18:01:37.544897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG passlib.handlers.bcrypt [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80582) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 18:01:37.576338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:37.590910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:37.592553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:37.599916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:37.622455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:37.691792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:37.704330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcfae78-8fce-4934-950c-ef501cce6a18 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:37.714253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:37.738752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:37.739474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.739757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.740031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.751133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:37.762255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:37.763169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:37.764010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:37.768471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:01:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:37.769119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:37.818338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93475739-246a-44e7-bf99-446fccf970a6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:37.820708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:37.851873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:37.856996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:37.857983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.858351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.858707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.869038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb3a4-809d-4837-bc37-cb6f0953abbb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:37.902318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:37.902982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:37.903273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:37.903546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:37.904321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:37.904626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:37.906036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:37.918369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:37.923821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:37.926154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:37.927676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.021032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e9864d-23f6-4f84-be58-6fac4daa0cea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:38.022833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 8/16] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:01:38.028308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:38.030973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:38.054191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:38.055061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:38.055348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:38.055626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:38.056807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:38.058275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.059911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 9/17] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:37 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:38.065258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:38.079417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:38.125396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb2d93-2915-49d9-968f-db463ecdba01 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:38.158155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:38.158963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:38.159256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:38.159536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:38.164521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e7951-2b77-44d5-bc86-6450648e18be None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:38.180508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:38.182096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.198719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:38.199511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:38.199795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:38.200073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:38.201273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:01:38.202167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:38.203109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:38.203967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:01:38.203967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:01:38.203967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:01:38.203967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:38.204208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.204286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 9/18] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:38.204427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 10/19] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:38.209314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:38.210036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:38.264933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:38.289857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:38.308632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00322c0f-2db7-4b34-8f11-bab94f743457 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:38.308857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa59205-0e54-4dec-9a7c-cd7e02f6f5d0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:38.341632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:38.342299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:38.342591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:38.342880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:38.343603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:38.343912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:38.344897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:38.345349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feafd76-a573-4864-bcf5-40e2c6cb5fa4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.345541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:38.345822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:38.346096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:38.346918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.domain.id=default, user.id=32e3d944938840afa028a580cf62f192) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:38.347224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:38.349277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058eb7f3-77c3-452c-bcff-31baff579349 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:38.356018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Jul 12 18:01:38 2022] GET /identity/v3/role_assignments?user.id=32e3d944938840afa028a580cf62f192&scope.domain.id=default&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:38.363479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:40.512213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234323-8ef7-432f-b561-768f0c7032f7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:40.513143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234323-8ef7-432f-b561-768f0c7032f7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:40.513615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39234323-8ef7-432f-b561-768f0c7032f7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:40.515331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:40.521225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606192-d574-4df1-b7d5-d13db03a2459 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:40.522023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606192-d574-4df1-b7d5-d13db03a2459 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:40.522492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd606192-d574-4df1-b7d5-d13db03a2459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:40.549142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fd606192-d574-4df1-b7d5-d13db03a2459 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:40.551167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd606192-d574-4df1-b7d5-d13db03a2459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:40.635597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:40.668043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234323-8ef7-432f-b561-768f0c7032f7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:40.793397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39234323-8ef7-432f-b561-768f0c7032f7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:40.821205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2cc67-37a0-410f-93c3-4c0f0dc21d52 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:40.821504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2cc67-37a0-410f-93c3-4c0f0dc21d52 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:40.821785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2cc67-37a0-410f-93c3-4c0f0dc21d52 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:40.823467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 12/24] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:40.834292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:40.834587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:40.834866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:40.868273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:40.869503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:40.884211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:40.885009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:40.885292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:40.885568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:40.913829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:40.934045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:40.934933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:40.936179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 13/25] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:01:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:40.942550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:40.950728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:40.978935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:41.035752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 13/26] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:01:41.100088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.151893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c9127d-bbb1-4833-98a0-56105b0e3e78 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.229952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.230640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.230932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.231218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.231983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:41.232324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.233731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.251259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 14/27] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:41.262549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.306364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8baaed-5d84-4312-9c8b-5152751a434f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.370595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.371329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.371615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.371894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.391186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.394815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.412499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-38e8a8ea-32a6-4a97-9b99-acc39da9d8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:01:41.426460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:41.427285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:41.428074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:01:41.428074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:01:41.428074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:01:41.428074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:41.442628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 14/28] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:41.444295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4b7c-5767-4e33-8829-cc5238af2f24 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.446150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4b7c-5767-4e33-8829-cc5238af2f24 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.447139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e4b7c-5767-4e33-8829-cc5238af2f24 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.449911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 15/29] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:41.453507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4b7c-5767-4e33-8829-cc5238af2f24 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.482989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83afbd61-d1c6-4498-8213-c429ab6357f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.524141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:41.544150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.544150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.544150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.544150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.544851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.544851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090ed7a-a755-417f-9d3e-966bba8a663d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.545352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 15/30] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:41 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:41.546358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.546654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.546936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.579555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:41.581009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:41.624344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e4b7c-5767-4e33-8829-cc5238af2f24 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.660530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 16/31] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:41.661666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.679664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.680640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.681090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.681524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.682463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:41.683514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.685897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe65f1c-f5b2-4cb9-bd53-5324d8d743e7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.700584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 16/32] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:01:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:41.701907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcbaa-39de-430d-963d-f2966eabd606 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.707380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcbaa-39de-430d-963d-f2966eabd606 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.707380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fcbaa-39de-430d-963d-f2966eabd606 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.707380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 17/33] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:41.707380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fcbaa-39de-430d-963d-f2966eabd606 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.770956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:41.806399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:41.823848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646eb59a-bcf1-4213-bf3c-b83ffb837bc2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.830399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fcbaa-39de-430d-963d-f2966eabd606 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:41.870545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.871316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:41.871702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.872218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.872374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:41.872771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.872888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:41.873081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:41.874031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.874267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:41.875810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.876166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604faa5f-a94a-4793-8ba9-dc91b889425c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:41.877556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 17/34] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:41.878303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:41.983046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b27727-e4bb-4081-8651-dad228f8ea54 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:42.012510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:42.017916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:42.018580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.018915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.019853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.020538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:42.021975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356ab20-91b1-4039-a59a-e7bde658afeb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:42.080613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 18/35] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Jul 12 18:01:41 2022] POST /identity/v3/roles => generated 219 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:42.082118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.082505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.083551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.101984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:42.103570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:42.192232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 19/36] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:42.193761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:42.266673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:01:41 2022] POST /identity/v3/projects => generated 301 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:42.268373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccafd-f8a4-4ba3-af48-6a73271784be None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.268664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccafd-f8a4-4ba3-af48-6a73271784be None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.268946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ccafd-f8a4-4ba3-af48-6a73271784be None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.274618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 19/38] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:42.274618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ccafd-f8a4-4ba3-af48-6a73271784be None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:42.284490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:42.311409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240cca1-b462-4f99-834a-11b643ddc47c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:42.362156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:42.363586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.363877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.364186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] PATH_INFO: `/v3/domains/default/users/32e3d944938840afa028a580cf62f192/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.366683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=32e3d944938840afa028a580cf62f192, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:42.368351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa20a4-41de-4083-a764-dce358814a9e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:42.403850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ccafd-f8a4-4ba3-af48-6a73271784be None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:42.438578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:42.439261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.439553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.439837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.440656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:42.448105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660a92d6-3d6e-4e26-9d37-10e543b7a2de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:42.472087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1361 bytes} [Tue Jul 12 18:01:42 2022] PUT /identity/v3/domains/default/users/32e3d944938840afa028a580cf62f192/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee61d9-19a5-43af-9f6b-c9ab54d8d0b9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee61d9-19a5-43af-9f6b-c9ab54d8d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee61d9-19a5-43af-9f6b-c9ab54d8d0b9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 21/40] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.483499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.483999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.496496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:42.497745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:42.537855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/roles => generated 225 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:42.549823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.551137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.551137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.578846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 22/42] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:42.585518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:42.587609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:42.603366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:42.650395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:42.688310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 21/43] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:42.692777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:42.712080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:42.733990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fc2fa-558d-4e10-99d2-3a8563c215b4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:42.772468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:42.773431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.773723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.774615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.774788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:42.776267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:42.829951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/roles => generated 223 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:01:42.833025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773589-05d8-4f41-877b-7a5fe0e07fec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:42.982573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:42.983299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:42.983588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:42.983867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:42.985094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:42.986581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49389a4d-a07e-4b02-8d20-dabcf2cb4240 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:42.988512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 22/45] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:42.993892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:43.097162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed14107-e500-41ab-a406-63c7b1c524cb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:43.123627 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:43.131147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:43.131817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:43.132107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:43.132420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:43.133190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:43.134614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797562-50e3-4be5-a976-687fb367edec None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:43.211374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:01:42 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:44.532175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1456-3089-4eb3-99f2-da825d4104d5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:44.532679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1456-3089-4eb3-99f2-da825d4104d5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:44.532781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d1456-3089-4eb3-99f2-da825d4104d5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:44.534095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 23/47] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:44.539981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:44.540416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:44.540698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:44.557399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:44.558592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:44.624346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 25/48] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:44.647643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1456-3089-4eb3-99f2-da825d4104d5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:44.691885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:44.748030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d1456-3089-4eb3-99f2-da825d4104d5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:44.782486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:44.783217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:44.783508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:44.783791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:44.794449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:44.802138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:44.802940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:44.803689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 24/49] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:44.809332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:44.913098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fffe79-b314-4283-9835-ed05ee3e7a64 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:44.923926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:44.946969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:44.947645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:44.947932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:44.948231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:44.948982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:44.949289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:44.950691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:44.963365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 26/50] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:44.968817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:45.066559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352809b-db3c-46f8-8556-aec9fb55cb31 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:45.068054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:45.098977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:45.099855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.100165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.100447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.101732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:45.103198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f640b-1a9f-4790-9c7d-5ef2774a3979 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:45.104869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 25/51] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:44 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:45.110259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:45.224397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623304a0-08e7-46a2-9cbb-114b3952c31f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:45.242153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751698b-cb68-4e33-bb80-c9f82fa442b9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.242440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751698b-cb68-4e33-bb80-c9f82fa442b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.242723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a751698b-cb68-4e33-bb80-c9f82fa442b9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.244139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 26/52] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:01:45.249776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.250058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.250333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.268414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:45.269632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:45.339775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 27/53] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:01:45.362083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:45.372516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:45.373329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.373620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.373905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.375100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:45.376602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:45.378254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 27/54] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:45.384366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:45.425951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:45.456594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:45.459577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28de6-8848-4e1b-80de-2728cbb68e66 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:45.484663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60002fe6-59f5-4734-b177-61c2a71ee636 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:45.493645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:45.494447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.494737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.495019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.496258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:45.497730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:45.499535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 28/55] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:45.504938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:45.517831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:45.518489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.518776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.519116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.519957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.domain.id=default, user.id=32e3d944938840afa028a580cf62f192) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:45.520300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:45.521748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25d4bc-8d1c-41b7-afab-99cfc905afdc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:45.530101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 28/56] 10.222.0.33 () {56 vars in 1322 bytes} [Tue Jul 12 18:01:45 2022] GET /identity/v3/role_assignments?user.id=32e3d944938840afa028a580cf62f192&scope.domain.id=default&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:45.607074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af965ca2-39a5-4268-a440-8730a87deedc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:45.642253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:45.642924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:45.643210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:45.643486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:45.644277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:45.645760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d219f5b-4fe1-461c-90fd-b8d29620930c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:45.747735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 29/57] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Jul 12 18:01:45 2022] POST /identity/v3/projects => generated 298 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:01:47.721628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221ee7-1e4a-4880-8868-ad99ba298a31 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:47.722202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221ee7-1e4a-4880-8868-ad99ba298a31 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:47.722202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd221ee7-1e4a-4880-8868-ad99ba298a31 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:47.723584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 29/58] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:47.728758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:47.729133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:47.729329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:47.746338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:47.747525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:47.761563 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:47.811470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 30/59] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:47.836544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd221ee7-1e4a-4880-8868-ad99ba298a31 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:47.934734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd221ee7-1e4a-4880-8868-ad99ba298a31 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:47.937085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:47.968307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:47.969102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:47.969397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:47.969685 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:47.970876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:47.972465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d775c-8e02-4f0f-a146-3f39a344c8ae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:47.974048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 30/60] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:47.979453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:48.074992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20717df-d40b-448d-b57c-56ff5a6c4d24 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:48.107104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:48.107768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:48.108053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:48.108361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:48.109073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:48.110537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48618928-5828-4ad9-9f10-4b2012ab86c0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:48.202976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 31/61] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:01:47 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:51.306034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ad9b-b166-4f61-8267-bfec78ad1ec3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.307046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ad9b-b166-4f61-8267-bfec78ad1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.307538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782ad9b-b166-4f61-8267-bfec78ad1ec3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.309157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 31/62] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:51.314305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.315148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.315685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.332293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:51.341238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:51.342467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:51.434047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 32/63] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:51.469432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ad9b-b166-4f61-8267-bfec78ad1ec3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:51.608515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782ad9b-b166-4f61-8267-bfec78ad1ec3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:51.655222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:51.656042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.656354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.656636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.677020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-53abdfb3-de9e-431e-bdd9-08c01766eea7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:51.686212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:51.687129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:51.687894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 32/64] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:51.695367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:51.742941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453d67-9fad-4930-8347-caf4387cee2c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.743123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453d67-9fad-4930-8347-caf4387cee2c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.743356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19453d67-9fad-4930-8347-caf4387cee2c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.744918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 33/65] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:01:51.750712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee6be-e461-493f-bfb8-2f0dce56d363 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.751000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee6be-e461-493f-bfb8-2f0dce56d363 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.751281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ee6be-e461-493f-bfb8-2f0dce56d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.773029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3b5ee6be-e461-493f-bfb8-2f0dce56d363 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:51.774751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b5ee6be-e461-493f-bfb8-2f0dce56d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:51.805111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:51.824499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eacc2d-af8e-4ac6-ab48-334d1254cc2b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:51.850071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 34/66] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:01:51.851690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04d3-e127-46fb-a0cc-91838038f6dc None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.851994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04d3-e127-46fb-a0cc-91838038f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.852785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a04d3-e127-46fb-a0cc-91838038f6dc None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.854433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 35/67] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:51.855509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52cad9-31f1-410c-b1eb-75d073c942e0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.855795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52cad9-31f1-410c-b1eb-75d073c942e0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.856077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f52cad9-31f1-410c-b1eb-75d073c942e0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.857325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 36/68] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:51.858602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13323d-4a9a-4518-8f9f-bf759e502344 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.859033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13323d-4a9a-4518-8f9f-bf759e502344 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.859494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13323d-4a9a-4518-8f9f-bf759e502344 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.860877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 37/69] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:51.865398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:51.865524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726c7b-b05e-4930-bb1e-4d531fafc865 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.865598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.865781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726c7b-b05e-4930-bb1e-4d531fafc865 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.865878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.866079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726c7b-b05e-4930-bb1e-4d531fafc865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.866185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.866856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:51.867175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:51.868618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ed619-a73f-4b22-900a-814dbbca329f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:51.871106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:51.877798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 33/70] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:01:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:51.880733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.880733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.880733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.884867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84726c7b-b05e-4930-bb1e-4d531fafc865 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:51.886067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84726c7b-b05e-4930-bb1e-4d531fafc865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:51.895984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:51.897187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:51.952632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 38/71] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:51.953902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:51.954191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:51.954479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:51.962687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 34/72] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:51.963587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:51.974773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:51.976279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:52.042858 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 39/73] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:52.043805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.068830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.085653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd8163-45c9-423d-93a6-7c693c9901d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.112941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.120314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.122468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.122468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.122468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.132087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:52.139737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:52.140625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:52.141379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 35/74] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:52.142250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.147749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d2a27a-19a8-431b-ba29-a33ec443c7c5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.181734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.182609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.182895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.183177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.198063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.199530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.201223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 40/75] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:52.201990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.241493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6cf66-7ed9-4a47-bb3f-fc505a041ce4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.274182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.274973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.275268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.275555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.276787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.278385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.280017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 36/76] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:52.280823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.285787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.301962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550c188e-8471-4f7d-953f-301d09af4582 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.335400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.336250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.336548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.336838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.337108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.347991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:52.361029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:52.361955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:52.363328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:52.363918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 41/77] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:52.365101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.388174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2055ea4-805a-4c2c-a6b6-ccfc92a7fa8f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.421823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.422641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.422931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.423213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.433793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:52.442152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:52.443007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:52.443995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 37/78] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:52.445239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.469072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634737a6-f1a0-49af-975d-7fced5a26ee9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.502756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.503485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.503814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.504092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.504871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:52.505182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.506568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.514519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 42/79] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:52.515380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.518023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.544074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95ae617-1a17-4c60-afc9-8049adf2bba6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.560761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.577720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.578372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.578665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.578951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.614877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750f2d1-2529-44f8-956f-9c2cefaaa217 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.644940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.646408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.647868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.648568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.648865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.649152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.649879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.651335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.724159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 43/80] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:01:52 2022] POST /identity/v3/users => generated 289 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:01:52.729148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.745098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 38/81] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:01:52.745913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.766254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.800905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:52.852693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba3ba1-2ef4-47ff-8188-5c9809caf571 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.860358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91027c66-a72e-4e3d-821c-adc76294ccc5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:52.891551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.892188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.892478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.892760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.893526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:52.894367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.895761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.900713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:52.901668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:52.902633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:52.902633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:52.903322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:52.903322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:52.905002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:52.907293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 44/82] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:52.907476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:52.915391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 39/83] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:52.916562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.015997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.042882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ec68b-070c-419e-9e3b-8af5be961b45 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.044147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bb3df3-4eee-4ae0-a096-3089d70336aa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.073419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.082897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.083827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.084216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.084437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.085875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.087355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.089467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 40/84] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:53.090307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.092433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.094652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.095225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.095707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.097247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.098926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.102344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 45/85] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:52 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:53.103811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.193667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527a45f-f9be-49a2-90b1-ac0a9a463b29 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.234492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.235621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.235910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.236229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.238112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.239573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.240074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2c35b-0669-4c70-ade1-45cb02f27304 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.241244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 41/86] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:53.242325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.263790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.285831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.287040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.287498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.287921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.290288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.292208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.294365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 46/87] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:53.295744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.370637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03712cab-9d60-48d9-a0d0-a33bbb82eb39 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.375831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.410704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.411614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.411997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.412398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.413382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:53.413790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.415618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.422599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 42/88] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=a07daedde46245149312ec8c706e6fef => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:53.423726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.435571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab10dc4-2dd0-49e9-8393-27c72fdf7b5e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.485759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.487891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.488399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.488827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.545638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.577202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.579243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.600554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a97fc-2ddf-487f-bc3d-3fbdec4d69ad None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:53.651773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.664870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:53.665569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:53.665860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:53.666399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:53.736372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 47/89] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:01:53.737174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.799281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:53.801361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:53.888502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:53.908398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 43/90] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:01:53.909886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:53.988426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9b99c-bb3a-43ba-a4e2-c02ef24c548e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.036306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada0a-c2c0-4470-8163-39bed62c383e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.072830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.073056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.073723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.074087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.074192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.074395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] PATH_INFO: `/v3/projects/9641b997c2604156a07489734a5b2781` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.074747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.075161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.075591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] RBAC: Authorizing `identity:get_project(project_id=9641b997c2604156a07489734a5b2781)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.077087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.078798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 44/91] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/projects/9641b997c2604156a07489734a5b2781 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.079702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:54.131348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:54.132743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:54.192625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a655d5c-46b9-44d3-a6c8-a52832627cdf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.231242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.232098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.232417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.232693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.233891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.240191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.240191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 45/92] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:54 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.240191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:54.249172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.250846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.372149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0312d4ed-e133-44fd-9355-4f420d85f7d5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.395759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:54.424327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 48/93] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:01:54.425311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:54.432612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.433272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.433557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.433831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.434670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=9641b997c2604156a07489734a5b2781, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:54.434981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.436469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.443613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 46/94] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:01:54 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=9641b997c2604156a07489734a5b2781&role.id=a07daedde46245149312ec8c706e6fef => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.444282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:54.498050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:54.543787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670653e-35ee-4091-8377-3c95983e7fdb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.580846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.581702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.582111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.582496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.583450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=32e3d944938840afa028a580cf62f192) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:54.583869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.585494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.591821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 49/95] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:01:54 2022] GET /identity/v3/role_assignments?user.id=32e3d944938840afa028a580cf62f192&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.626007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f690cc-b775-4c7e-b90a-d49a1826aab2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.674551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.676017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.676334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.676617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.677973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.679498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fae9ce-127d-427a-b72a-4ba4850b0b9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.681812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 47/96] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:54 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.687706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:54.799016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c078e-8822-49e5-b907-999f2186bc84 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:54.839772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:54.840486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:54.840775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:54.841063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:54.841928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:54.842249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:54.843736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a462-6881-4048-adee-f6144dc69f4f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:54.850930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 50/97] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:01:54 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:54.852516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:55.359615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa9b0-616e-4606-b115-5eefb53e5312 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:55.360018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa9b0-616e-4606-b115-5eefb53e5312 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:55.360213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa9b0-616e-4606-b115-5eefb53e5312 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:55.361865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 48/98] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:55.367789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00929c2-55a0-4640-a327-b2ae323bbc81 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:55.368089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00929c2-55a0-4640-a327-b2ae323bbc81 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:55.368406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00929c2-55a0-4640-a327-b2ae323bbc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:55.385289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a00929c2-55a0-4640-a327-b2ae323bbc81 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:55.386494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a00929c2-55a0-4640-a327-b2ae323bbc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:55.456688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 51/99] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:55.479604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa9b0-616e-4606-b115-5eefb53e5312 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:55.539187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:55.560494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110169ff-c825-4fb9-85e4-0686d2377dce None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:55.560791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110169ff-c825-4fb9-85e4-0686d2377dce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:55.562181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110169ff-c825-4fb9-85e4-0686d2377dce None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:55.562786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 52/100] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:55.567788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:55.568084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:55.568400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:55.602457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:55.603689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:55.666307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa9b0-616e-4606-b115-5eefb53e5312 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:55.715137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:55.717715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:55.721027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:55.722398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:55.724939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 53/101] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:01:55.725800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:55.727543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:55.729473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 49/102] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:55.735802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:55.754975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:55.852594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:55.951799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20083a-b1b9-4010-bb58-21aae2534961 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:55.996394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6acf1-68a1-4295-8ddc-e725433d5043 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.011369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:56.020005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.020783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.021073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.025820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.025820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:56.025820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69937a2c-0d0d-48a5-8e35-eb44ccdd85ff None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:56.033359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.034191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.034482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.034762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.045749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6b2e7303-a3c8-4bff-8cd1-687e842c8419 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:56.053504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:56.054344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:56.055083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 50/103] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:56.056242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb725-eb23-4bf7-8b80-d11d6e15a6eb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.056242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb725-eb23-4bf7-8b80-d11d6e15a6eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.056541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcb725-eb23-4bf7-8b80-d11d6e15a6eb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.058052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 51/104] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:56.062723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb725-eb23-4bf7-8b80-d11d6e15a6eb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.133770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 54/105] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:01:55 2022] POST /identity/v3/projects => generated 302 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:01:56.135151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.135445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.135807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.170500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcb725-eb23-4bf7-8b80-d11d6e15a6eb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.181354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:56.182601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:56.207374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.207953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.208301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.208582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.209342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:56.209654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:56.211104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:56.220667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 52/106] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:56.225991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.262629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:56.335606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f56144-842f-4c9c-932d-b663418df818 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.372573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.373484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.373775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.374055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] PATH_INFO: `/v3/users/e18f2951b7d14abbaee2cb03798bcdcb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.384896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 55/107] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:56.389579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] RBAC: Authorizing `identity:get_user(user_id=e18f2951b7d14abbaee2cb03798bcdcb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:56.391068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:56.392998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 53/108] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/users/e18f2951b7d14abbaee2cb03798bcdcb => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:56.398610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.430907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.442568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:56.581767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af0200c-4c7e-4bb4-9976-a28627873725 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.606431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:56.619649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc17-cdc5-4f40-9904-f8e1851d5d30 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.651431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.652104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.652475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.652777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.674147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.675505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.675792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.676069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.697730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:56.705500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:56.706388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:56.707164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:56.708335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 54/109] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:56.717140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.781509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:56.782991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:56.834131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:56.906646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d87792-099e-4909-b4df-9a4ce5113665 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:56.971566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 56/110] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:01:56.973100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:56.974021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:56.974510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:56.974980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:56.975941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:56.976481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:56.977775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:56.978555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.000244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 55/111] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:57.006173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.044375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:57.198669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c359deb-7ad3-41e7-bef5-3bc1b656e33c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.214076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35903bf-9327-4743-a8f1-a56ff2afed85 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.265915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:57.266091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.267017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.267309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.267588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.270358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:57.271845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf6fd70-d1c1-4574-a8ea-7bf6755ec7a8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.273534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 56/112] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:57.274997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45e14-c849-4481-8514-59a096a7b67c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.275295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45e14-c849-4481-8514-59a096a7b67c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.275578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd45e14-c849-4481-8514-59a096a7b67c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.276866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 57/113] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:57.281482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd45e14-c849-4481-8514-59a096a7b67c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.300857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.301964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.302258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.302538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.305044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:57.306533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499c412-efa2-4b4c-a8cb-174e9d123d8d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.312228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 57/114] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:56 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:57.313509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.313799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.314078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.351105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:57.353572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:57.432299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:57.452920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd45e14-c849-4481-8514-59a096a7b67c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.454609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 58/115] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:57.455466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.489057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.490376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.490865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.491380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.492964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:57.494612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6470b-e4cd-4eb0-b493-8a5af3495eb2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.496759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 58/116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:57.498237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8123a-46f3-422c-931f-89e029503188 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.498723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8123a-46f3-422c-931f-89e029503188 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.499210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff8123a-46f3-422c-931f-89e029503188 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.500804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 59/117] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:57.506246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8123a-46f3-422c-931f-89e029503188 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.581862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10971-8acd-4288-8223-605c4a6bc126 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.605817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:57.616637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.617312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.617604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.617895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.618742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=e18f2951b7d14abbaee2cb03798bcdcb) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:57.619060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:57.620607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.623641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff8123a-46f3-422c-931f-89e029503188 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.626380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 59/118] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/role_assignments?user.id=e18f2951b7d14abbaee2cb03798bcdcb&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=e85c6d9c982c48d5843351f798e7036b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:57.627595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.687501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.688494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.689051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.689336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/users/c6ae44ed6e014d21a3fad60503910b5f/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.694231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, user_id=c6ae44ed6e014d21a3fad60503910b5f, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:57.698725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe10c68-a25f-486d-ab47-45f8c820f40b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:57.762691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2643fe-a837-41eb-9508-3c0471874505 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:57.776220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 60/119] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:01:57 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/users/c6ae44ed6e014d21a3fad60503910b5f/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:01:57.777560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.777855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.778138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.800295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:57.801557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:57.815232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:57.876903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:57.877736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:57.878596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:57.878884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:57.906110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 61/120] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:57.917500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:57.926076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:57.926971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:01:57.927721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:57.932253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 60/121] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:57.933313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:57.941526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.030480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.083981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4476f-b837-458b-a57c-3b3c4b77f50d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.098955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab95823-0dc6-4056-b41a-7ad997883622 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.125272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.126052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.126413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.126766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.127606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:58.128580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.130079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31a316-3a3e-428a-9c04-c9a17072de01 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.139087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 62/122] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:58.143997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9c35-9429-41ad-8986-277e385f314b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.143997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9c35-9429-41ad-8986-277e385f314b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.143997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdd9c35-9429-41ad-8986-277e385f314b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.144269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 63/123] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:58.145269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd9c35-9429-41ad-8986-277e385f314b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.148364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.149632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.149877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.150268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.151570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.165456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ca0e66e7-dee9-4d1d-88f9-5146386fb731 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:58.176932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:58.177848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:01:58.178591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:01:58.181346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 61/124] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:01:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:01:58.183130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.183601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.184004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.205567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:58.207491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:58.265506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdd9c35-9429-41ad-8986-277e385f314b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.297850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 62/125] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:58.297850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.307520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.308444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.308739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.309023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.310278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.312089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.313476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 64/126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:58.318856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.348515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.431512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.446076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec835307-8753-4506-a327-7112bc4103a3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.475076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a94ba-5e68-4cd2-9537-73d2320c0166 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.517705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.519141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.519436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.519721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.520573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:58.520893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.522310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.530906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.531790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.532084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.532412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] PATH_INFO: `/v3/projects/9641b997c2604156a07489734a5b2781` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.533642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] RBAC: Authorizing `identity:get_project(project_id=9641b997c2604156a07489734a5b2781)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.535178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.536949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 65/127] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/projects/9641b997c2604156a07489734a5b2781 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:58.537733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.539838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 63/128] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:58.554616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.657402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dd2f2-185d-44d2-9820-cfade62d2083 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.671007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.674763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c58cf6-f739-4f0c-9dc9-cf706d8c749d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.691746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.692614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.694810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.694810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.703973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:01:58.712830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:01:58.713737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:01:58.714503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 66/129] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:01:58.715130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.728551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.777409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.778332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.778624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.778908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] PATH_INFO: `/v3/projects/9641b997c2604156a07489734a5b2781/users/c6ae44ed6e014d21a3fad60503910b5f/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.786199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] RBAC: Authorizing `identity:create_grant(project_id=9641b997c2604156a07489734a5b2781, user_id=c6ae44ed6e014d21a3fad60503910b5f, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.787674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.826602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf070929-f85b-4e1c-9f3d-f681af1e74fd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:58.863753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:58.864726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:58.865025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:58.865311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:58.866534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:58.868025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:58.870061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 67/130] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:58.870949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.899245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 64/131] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:01:58 2022] PUT /identity/v3/projects/9641b997c2604156a07489734a5b2781/users/c6ae44ed6e014d21a3fad60503910b5f/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:01:58.899948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:58.952499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:58.979939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475dce1-0e26-4b9b-a58d-4cdb0f41669a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.017391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.018192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.019144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.019405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.020201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:01:59.020523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.021954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.031099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 68/132] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:59.038310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:59.154086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43249b0-afe7-4acb-8b4a-4979ad2c890e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.218915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea3435d-34b0-4919-aed8-3574909221cb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.221277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.222368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.222667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.222956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.224226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.225726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.227913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 65/133] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:58 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:59.237168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:59.251027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:59.257190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.258092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.258379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.259286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.259944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.261445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.263212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 69/134] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:01:59 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:59.269617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:59.275280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:59.377151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace84d9-d3d6-40b2-9307-73c7e97f20df None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.422250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6262e671-5a1b-4abf-a349-0cc46a80ea56 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.422417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.423111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.423400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.423686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/users/32e3d944938840afa028a580cf62f192/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.427431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, user_id=32e3d944938840afa028a580cf62f192, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.428965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1de7e2-1085-4178-b974-9db386b5aab9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.466221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.467155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.467439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.467711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.468958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.470500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3f2bff-6ed2-4605-b645-55c798d444a4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.472744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 70/135] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:01:59 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:01:59.473866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee942-ec92-4153-8556-9f2916ba66d7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.474194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee942-ec92-4153-8556-9f2916ba66d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.474466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ee942-ec92-4153-8556-9f2916ba66d7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.475698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 71/136] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:01:59.480054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee942-ec92-4153-8556-9f2916ba66d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:59.523641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 66/137] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:01:59 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/users/32e3d944938840afa028a580cf62f192/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:01:59.529230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.529529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.529823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.564539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:59.568255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:01:59.575844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:01:59.631509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ee942-ec92-4153-8556-9f2916ba66d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.689789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.692028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.692530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.693178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/users/c6ae44ed6e014d21a3fad60503910b5f/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.695852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, user_id=c6ae44ed6e014d21a3fad60503910b5f, role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.697581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.747053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 67/138] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:01:59.764068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 72/139] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:01:59 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/users/c6ae44ed6e014d21a3fad60503910b5f/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:01:59.781171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:01:59.806921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:01:59.913444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045e262-2536-4f93-940f-9a70f49557a6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:01:59.961501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:01:59.962258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:01:59.962618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:01:59.962908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:01:59.967045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:01:59.968686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0438ea8d-d837-4cbb-b6ed-e4360e082b57 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:01:59.970443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 68/140] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:01:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:01:59.976672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:00.084867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798ba9-e8d3-406f-8978-6137c81484c7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:00.116570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:00.123641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:00.124355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.124644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.124928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.125659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:00.127124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97afec9-e81b-45a7-934d-909517f9ad58 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:00.255726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 73/141] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:01:59 2022] POST /identity/v3/users => generated 283 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:00.375493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d887-920c-4347-a8c8-eb1474bf515c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.375826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d887-920c-4347-a8c8-eb1474bf515c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.376062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe7d887-920c-4347-a8c8-eb1474bf515c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.377898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 69/142] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:00.383529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.383816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.384101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.405395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:00.406656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:00.498905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 74/143] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:00.535360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7d887-920c-4347-a8c8-eb1474bf515c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:00.634366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:00.656588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe7d887-920c-4347-a8c8-eb1474bf515c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:00.703606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:00.704469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.704759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.705037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.721315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-386310f4-4670-4296-9817-687e95d33d0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:00.729331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:00.730188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:00.731555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 70/144] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:00.736573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:00.841372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830521c-d854-4b54-bfa3-0289c0ad9f76 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.841867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830521c-d854-4b54-bfa3-0289c0ad9f76 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.841941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830521c-d854-4b54-bfa3-0289c0ad9f76 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.843587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 71/145] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:00.850430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.850721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.851007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.881488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:00.882717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:00.929132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a01de40-2f8a-4bcf-86fa-630a4309dd9f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:00.956517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:00.984948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:00.985623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:00.985910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:00.986188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:00.987637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:00.987946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:00.991934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.002138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 75/146] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:01.008519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.034449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 72/147] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:01.117361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.142270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7441e6ac-5a20-43d6-93c6-a55b2d06054d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.184263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.186009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.186297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.186581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] PATH_INFO: `/v3/users/e18f2951b7d14abbaee2cb03798bcdcb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.187854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] RBAC: Authorizing `identity:get_user(user_id=e18f2951b7d14abbaee2cb03798bcdcb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:01.189382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.191687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 76/148] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/users/e18f2951b7d14abbaee2cb03798bcdcb => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:01.197697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.251728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:01.261294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:01.310633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b2aed-e768-448e-b665-414b8c45d098 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.318617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8912c-757b-43ec-bf28-051c21b95378 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.357636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.358510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.358798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.359098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.360793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:01.363142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.365270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 77/149] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:01.371247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.372393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.373425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.373989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.374437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.392014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:01.400687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:01.401628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:01.402376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:01.409634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 73/150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:01.414873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.483049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ef297-d5a8-4c7a-b1c6-aa209b59c3e6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.495521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:01.522293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.531120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.531120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.531120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/users/e18f2951b7d14abbaee2cb03798bcdcb/roles/e85c6d9c982c48d5843351f798e7036b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.531120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, user_id=e18f2951b7d14abbaee2cb03798bcdcb, role_id=e85c6d9c982c48d5843351f798e7036b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:01.531120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.587082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ee555-fe38-423b-a0d8-80b613102d07 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.596104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 78/151] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:01 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/users/e18f2951b7d14abbaee2cb03798bcdcb/roles/e85c6d9c982c48d5843351f798e7036b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:02:01.632045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.632703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.632991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.633273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.634054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:01.634366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:01.635818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.641779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:01.650293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 74/152] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:01.655764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.805657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b796b922-5cd7-46f6-a336-5f6ebea5c4ae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:01.856513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:01.857393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.857763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.858044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.865088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:01.866615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ccd7a2-d88c-44c5-9c29-27521fc9d1a1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:01.868775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 79/153] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:01.874108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:01.957934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f370b-ad73-436a-a8d8-c85e61b779f2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.958222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f370b-ad73-436a-a8d8-c85e61b779f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.958420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8f370b-ad73-436a-a8d8-c85e61b779f2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.962600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 80/154] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:01.965518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:01.966068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:01.966170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:01.992052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:01.993395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:02.013263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01840b93-68d4-491e-b398-d112395727e2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.044485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:02.051418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.052226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.052640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.053099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.111154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 81/155] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:02.122276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:02.125935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:02.127406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:02.157055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:02.230055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 75/156] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:02.235453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:02.334214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:02.338116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72573e65-47bf-4cdb-885a-7c4b6dabe86b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.350410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d03db1-ae62-4dd5-b41c-173f3ee494d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.381737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.382611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.382891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.383164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.388902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:02.390581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:02.392381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 76/157] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:02.398033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:02.413937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.414938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.415294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.415640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.437063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:02.445989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:02.446847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:02.447941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 82/158] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:02.453248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:02.508646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:02.546312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb530-8628-45cc-9558-3a6205056c9e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.605424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.606100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.606386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.606665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.607514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:02.607827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:02.609474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:02.620333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 77/159] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=a07daedde46245149312ec8c706e6fef => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:02.633681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef11c7-6a9e-4831-afd3-434cdd36389b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.670118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.671198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.671695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.672205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.673208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:02.673718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:02.675927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:02.685897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 83/160] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:02.692344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:02.737912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:02.851682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8629e1-c652-436e-ae17-79d90addb404 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:02.897425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:02.898349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:02.898640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:02.898916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:02.900265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:02.901737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2e362-74fc-4fe7-9e0f-d9e8a3fa3983 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:02.903619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 78/161] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:02.909573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:03.068444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:03.076949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f10c920-d177-411d-ac38-c0b9aae5ff09 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:03.118401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:03.119063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.119345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.119621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.192786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e6a-7294-4c0a-87bb-623a403cf054 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.193450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e6a-7294-4c0a-87bb-623a403cf054 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.193934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af0e6a-7294-4c0a-87bb-623a403cf054 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.195742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 79/162] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:03.204488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.205391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.206551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.212803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:03.216272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:03.239571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:03.242150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:03.372397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 84/163] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:03.372572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:03.379722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:03.380912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 80/164] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:03.425341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:03.478391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:03.516042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05036525-b352-43c4-8ddc-e6bdb500a3fa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:03.585396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:03.586616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.587096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.587564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] PATH_INFO: `/v3/projects/9641b997c2604156a07489734a5b2781` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.589102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] RBAC: Authorizing `identity:get_project(project_id=9641b997c2604156a07489734a5b2781)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:03.590766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:03.593032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 85/165] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:03 2022] GET /identity/v3/projects/9641b997c2604156a07489734a5b2781 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:03.616392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f25c0-16db-44c6-b595-1d4a62cdd14a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:03.617533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:03.681845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:03.682887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.683321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.683743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.703784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7cc377c8-b314-4d73-ac81-e7471e660d92 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:03.719444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:03.720406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:03.721409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:03.723915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 81/166] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:03.725416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951547ca-7cd2-408b-aa03-6b541af7179c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.725914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951547ca-7cd2-408b-aa03-6b541af7179c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.726374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951547ca-7cd2-408b-aa03-6b541af7179c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.728141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 82/167] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:03.734275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:03.734828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:03.735309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:03.762707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:03.764277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:03.801038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:03.881280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 83/168] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:03.881970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:03.923923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:03.978129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f7bdc-eac3-49e8-bbb9-42d8312bd4bd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.060712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c09a5-f7f4-47cc-96a4-4b77f10c6f0f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.073633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.074322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.074608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.074881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.075752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=9641b997c2604156a07489734a5b2781, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:04.076068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.077611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.095290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 86/169] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:03 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=9641b997c2604156a07489734a5b2781&role.id=a07daedde46245149312ec8c706e6fef => generated 608 bytes in 479 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:04.096161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.116066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.116804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.117090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.117369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.118150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:04.118460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.119887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.140283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 84/170] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:04.142160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.271896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:04.286469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99155d9e-8a68-4eec-a53b-392d6719bfbe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.301260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c357d6f-7a28-4b23-abcf-334ab540787a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.317074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:04.334035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.334868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.335156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.335434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.352349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:04.365526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.366451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.366738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:04.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:04.367670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:04.368927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:04.369765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] PATH_INFO: `/v3/users/32e3d944938840afa028a580cf62f192` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.369834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 87/171] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:04.369897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] RBAC: Authorizing `identity:get_user(user_id=32e3d944938840afa028a580cf62f192)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.370038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.371708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 85/172] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/users/32e3d944938840afa028a580cf62f192 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:04.377260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.378862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.553261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c12c107-ef1a-498a-bfa5-73095a6f5af2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.558265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd446a-f078-4131-bcdf-33537b110692 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.613121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.614302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.614738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.615163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.653473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.654499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.654988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.655458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.656458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:04.657016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.658594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.682112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 86/173] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:04.686977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:04.687938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.715587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:04.715880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.717366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.873130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f72d5-1fae-4e95-81a3-0c5de5837101 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:04.907618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 88/174] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:04.915456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:04.924275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:04.926572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:04.927100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:04.927582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] PATH_INFO: `/v3/users/c6ae44ed6e014d21a3fad60503910b5f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:04.929262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] RBAC: Authorizing `identity:get_user(user_id=c6ae44ed6e014d21a3fad60503910b5f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:04.931474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:04.935718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 87/175] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/users/c6ae44ed6e014d21a3fad60503910b5f => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:04.946381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.087085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.119679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.123908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff6e80-67f1-424e-89b0-0c6217bc2a07 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.147848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a27bee-383c-425e-967c-b6d5f03757ca None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.165403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.166883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.167173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.167443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.168951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:05.170867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0514a71b-cfb1-4168-aa6e-cb393c4e3244 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:05.173030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 89/176] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:05.176575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c247f4-c5d6-464a-9715-15b5976860bc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.177096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c247f4-c5d6-464a-9715-15b5976860bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.177585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c247f4-c5d6-464a-9715-15b5976860bc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.179144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 90/177] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:05.180543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6915-4335-4065-bf41-7f1699b9f877 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.181124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6915-4335-4065-bf41-7f1699b9f877 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.181628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a6915-4335-4065-bf41-7f1699b9f877 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.183378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 91/178] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:05.188083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a6915-4335-4065-bf41-7f1699b9f877 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.194595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.195257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.195541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.195820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.269143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:05.270179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e397da-e0c3-4d02-a14b-9435e706b78a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:05.329457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752a6915-4335-4065-bf41-7f1699b9f877 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.353626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.369474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.370441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.370935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.371507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.372615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=32e3d944938840afa028a580cf62f192) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:05.380837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:05.380837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847207d7-b946-4a9d-a9f7-69439e6f29ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:05.381020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 88/179] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:05.381361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 92/180] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/role_assignments?user.id=32e3d944938840afa028a580cf62f192&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:05.382565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728b94-ef6c-46ec-b790-41f39a554d69 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.382857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728b94-ef6c-46ec-b790-41f39a554d69 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.383139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4728b94-ef6c-46ec-b790-41f39a554d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.383414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.383880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.384378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.422581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b4728b94-ef6c-46ec-b790-41f39a554d69 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:05.424143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b4728b94-ef6c-46ec-b790-41f39a554d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:05.425419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:05.429009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:05.449665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.522383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 93/181] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:05.523609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.547918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 89/182] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:05.553015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b491f-5df1-41e3-a800-e4216387975c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.554525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b491f-5df1-41e3-a800-e4216387975c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.555055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b491f-5df1-41e3-a800-e4216387975c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.559853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 90/183] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:05.565107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b491f-5df1-41e3-a800-e4216387975c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.663084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3612f6-abe2-4798-b787-bdbdabd9907a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.694464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b491f-5df1-41e3-a800-e4216387975c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.696879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.697738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.698019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.698289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.699458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:05.700938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:05.702647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 94/184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:05.703416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.703952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.722401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:05.735791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.736623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.736909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.737186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.747282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8c4de472-3123-411e-ac07-27cc6bae0ba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:05.755676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:05.756714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:05.757536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 91/185] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:05.758201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e7f7-173e-4a59-93ea-fd4bf464ff55 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.758356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e7f7-173e-4a59-93ea-fd4bf464ff55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.758637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054e7f7-173e-4a59-93ea-fd4bf464ff55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.774946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a054e7f7-173e-4a59-93ea-fd4bf464ff55 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:05.776668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a054e7f7-173e-4a59-93ea-fd4bf464ff55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:05.809258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca2768-34ff-463a-ae22-dd775f93479d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:05.844382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:05.844947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 92/186] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:05.845176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.845456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.845727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.846438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603cc3-1279-42b5-b095-d5269eaffbe1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:05.846672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603cc3-1279-42b5-b095-d5269eaffbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:05.846946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c603cc3-1279-42b5-b095-d5269eaffbe1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:05.848237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 93/187] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:05.852258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c603cc3-1279-42b5-b095-d5269eaffbe1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:05.866609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:05.874363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:05.875252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:05.876300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 95/188] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:05.876968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.000582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.005766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c603cc3-1279-42b5-b095-d5269eaffbe1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.006483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.035796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485112fc-65c1-465d-8756-88b9aab830fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.039883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.042093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.042093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.042093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.042421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=c6ae44ed6e014d21a3fad60503910b5f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:06.042562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.044029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a6c352-b563-49d5-a432-be00f8aeb977 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.050545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 94/189] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/role_assignments?user.id=c6ae44ed6e014d21a3fad60503910b5f&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.051762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.052053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.052365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.073595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.074284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.074520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:06.074632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.074838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.075616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:06.075774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:06.075935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.077405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.089054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 96/190] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.093260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.158265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 95/191] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:06.168331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.217603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181883d6-50f4-4046-80b6-3467b5ef0b0a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.259053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.259796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.260078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.260380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.262416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.272864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:06.280361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:06.281257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:06.282120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:06.282894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 97/192] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:06.289523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.293002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9de61-2e55-4a8f-b81d-859aedaae8db None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.332399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.333079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.333364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.333678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.334436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:06.334743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.336178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.344373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 96/193] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.345168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.390044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746454ad-4395-4885-8695-4217ec8c853c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.424015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.424941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.425219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.425495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.438756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.440822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.442507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 98/194] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.447397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ab3db0-701c-45ef-9f02-75caddd00b0f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.447795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.481540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.482395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.482911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.483212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.484497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.485948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.487784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 97/195] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.488467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.506026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.516953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.553191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da8697-2153-46f0-b6f4-b0bd855fd45f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.586248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bdb846-0575-4e11-a6ee-3a639cf34d16 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.624953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.624953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.624953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.624953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.625364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:06.625364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.625364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.625364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 99/196] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.625364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.625738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.625738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.625738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.625983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] PATH_INFO: `/v3/users/e18f2951b7d14abbaee2cb03798bcdcb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.627217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] RBAC: Authorizing `identity:get_user(user_id=e18f2951b7d14abbaee2cb03798bcdcb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.629241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.630935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 98/197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/users/e18f2951b7d14abbaee2cb03798bcdcb => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:06.631669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.700169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a5230-b426-428c-8273-d210e6bc767b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.713924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.729882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.732855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.733501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.733803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.734078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.739334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d25d0b-9765-4151-9f23-71fb49a607c3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:06.772725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:06.773339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:06.773656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:06.774485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:06.775437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.777450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.799095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:06.801191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:06.854886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 99/198] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:06 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:06.855864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.907667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 100/199] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:06.908446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:06.926475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:06.978215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95af27-51f4-4cf6-acd7-0bf1d27c8146 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.016536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.017538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.017817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.018259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.019552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88c79e-efef-4ce1-b4d8-9a76dda2e2fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.019724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.021234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.024524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 100/200] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:07.024524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.044330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.062330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.062330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.062330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.065736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.147335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c85bb9-49bb-443a-8791-b03c9b811baa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.154898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.156519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.172655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.189852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.191582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.191714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.191998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.193367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.194938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.198084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 101/201] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:07.198709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.272067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 101/202] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:07.273214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.287825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.313942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b897c9-b031-491d-ad0f-debc328f3cd3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.354346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.355275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.355764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.356265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.407736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3d278-0751-4d5f-9f3e-96c3a4bdc884 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.429116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.431119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.432890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.455215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.456962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.457783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.458586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.460036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=a914dda46b184ee88aab37538f75d6cb) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:07.460853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.462630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.470075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 102/203] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/role_assignments?user.id=a914dda46b184ee88aab37538f75d6cb&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:07.471786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.570958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.617062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 102/204] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:07.622300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.649260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372f3d8-59c5-42ae-a5a0-64699e33a515 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.715947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.717103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.717554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.717987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.724837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.726503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.728443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 103/205] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:07.734164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.765413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910bb61-ae92-40ba-a849-1b10aac55461 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.815791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.816748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.817093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.817425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.818665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.820336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.822350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 103/206] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:07.832153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:07.834794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.883828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:07.889743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095456d-3aa4-472d-8975-939ed0a3bbe1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.940767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5e55c-3223-4a96-a108-123fbf499b65 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:07.944797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.945690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.946191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.946691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.947732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, scope.project.id=a84ac953b4694932bf393a1817f5e085, user.id=e18f2951b7d14abbaee2cb03798bcdcb) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:07.948272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.956543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddf4d99-ea5e-486a-bf75-c27799eadf3b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.966738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 104/207] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/role_assignments?user.id=e18f2951b7d14abbaee2cb03798bcdcb&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=e85c6d9c982c48d5843351f798e7036b => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:07.983416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:07.984093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:07.984416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:07.984698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:07.985610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=a914dda46b184ee88aab37538f75d6cb) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:07.985978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:07.988055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf483f-af1a-41e4-aa59-5e8012eb422e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:07.994830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 104/208] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:07 2022] GET /identity/v3/role_assignments?user.id=a914dda46b184ee88aab37538f75d6cb&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:09.131710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b74c-d77a-4a30-ab86-3a1ed8bb2fc8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.132233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b74c-d77a-4a30-ab86-3a1ed8bb2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.132233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8b74c-d77a-4a30-ab86-3a1ed8bb2fc8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.133837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 105/209] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:09.139102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302fa12-e819-40c3-ad08-9a6e8b997df7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.139510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302fa12-e819-40c3-ad08-9a6e8b997df7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.139677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302fa12-e819-40c3-ad08-9a6e8b997df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.157080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2302fa12-e819-40c3-ad08-9a6e8b997df7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:09.158287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2302fa12-e819-40c3-ad08-9a6e8b997df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:09.230660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 105/210] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:09.254614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b74c-d77a-4a30-ab86-3a1ed8bb2fc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.348048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760afb8-884a-4e81-b584-fd5e22b9860f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.348384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760afb8-884a-4e81-b584-fd5e22b9860f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.348662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760afb8-884a-4e81-b584-fd5e22b9860f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.350057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 106/211] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:09.354897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.355188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.355472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.366545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8b74c-d77a-4a30-ab86-3a1ed8bb2fc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.372991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:09.374169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:09.378987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:09.406330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.406330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.406330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.406330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.415578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:09.421707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:09.423706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:09.425240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:09.426096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 106/212] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:09.433076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.461590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 107/213] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:09.487751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.545812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce7f15-2c30-4c23-8bcf-4384e64ec342 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.589137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.590628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.591532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.592155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.593229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:09.594002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:09.596942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:09.607654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 107/214] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:09.613876 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.620941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbb2066-f39e-4c2b-b61f-2260cd6be9d4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.651742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:09.667482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.668260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.668532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.668810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.670632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:09.672294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:09.675386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 108/215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:09.680574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.727690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:09.735526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d434cd-3ad6-40ee-82fc-950b914c5924 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.771912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.772870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.773160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.773437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] PATH_INFO: `/v3/users/6255e2afa0774adb9fb1a35aabbfc891` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.788260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee1b34-cb8b-468f-a183-577d62e345f5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.794658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] RBAC: Authorizing `identity:get_user(user_id=6255e2afa0774adb9fb1a35aabbfc891)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:09.796502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110b473-e090-4ae7-9ac7-b06f8f8d51d2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:09.798521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 108/216] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:09 2022] GET /identity/v3/users/6255e2afa0774adb9fb1a35aabbfc891 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:09.800659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6783-1207-4aa3-aa72-bd76ddbfbd40 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.800950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6783-1207-4aa3-aa72-bd76ddbfbd40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.801227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f6783-1207-4aa3-aa72-bd76ddbfbd40 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.802695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 109/217] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:09.804997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6783-1207-4aa3-aa72-bd76ddbfbd40 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:09.831682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.832390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.832680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.832957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.833671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:09.835115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124ac5e-3bb5-42f4-82e1-db428244b621 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:09.902635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:09.913936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f6783-1207-4aa3-aa72-bd76ddbfbd40 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:09.918647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 109/218] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:09 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:09.921848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef603-a604-45cd-925b-14189c485a01 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.922149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef603-a604-45cd-925b-14189c485a01 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.922580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ef603-a604-45cd-925b-14189c485a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:09.945228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-157ef603-a604-45cd-925b-14189c485a01 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:09.946941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-157ef603-a604-45cd-925b-14189c485a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:09.960536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:09.961403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:09.961635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:09.961917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.037819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 110/219] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:10.050693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:10.052545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9392a2-793e-4c0b-9b90-00f911e9d42c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:10.063860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef603-a604-45cd-925b-14189c485a01 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.094250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.169874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.178361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ef603-a604-45cd-925b-14189c485a01 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.180640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 110/220] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:10.184256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2c97-b972-4d85-b48a-42bc41d5c92e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.184256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2c97-b972-4d85-b48a-42bc41d5c92e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.184256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e2c97-b972-4d85-b48a-42bc41d5c92e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.184256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 111/221] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:10.186448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2c97-b972-4d85-b48a-42bc41d5c92e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.222870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.223758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.224901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.224901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.236968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-946f78e5-d5e4-4ca3-8dbf-fa3d375200da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:10.245018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:10.246047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:10.246832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 111/222] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:10.248198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.248564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.248857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.267783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:10.269651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:10.311754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e2c97-b972-4d85-b48a-42bc41d5c92e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.346174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 112/223] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:10.347576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.352689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.353548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.353830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.354102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.355292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:10.356808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:10.358902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 112/224] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:10.364551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.370254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.429545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.473877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6903c73c-16d1-41b9-8467-40766add206e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.485398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0f3bc-f9e9-4bb4-ab10-d0e4c97c2726 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.509649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.510305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.510588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.510868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.511704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=6255e2afa0774adb9fb1a35aabbfc891) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:10.512017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:10.513497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:10.524240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 113/225] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/role_assignments?user.id=6255e2afa0774adb9fb1a35aabbfc891&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=a07daedde46245149312ec8c706e6fef => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:10.525189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.532675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.533773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.534267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.535084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.537264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:10.537857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:10.539490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:10.552768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 113/226] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:10.559024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.689173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.714203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5575-b21f-4196-8601-30e39577c1ee None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.715763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36ff91-d13e-4bb2-90ed-794ba717dfc1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.744405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:10.756724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.758927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.758927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.758927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.759846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:10.761970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:10.764447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 114/227] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:10.769784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.781113 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:10.782539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:10.782826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:10.783098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:10.816809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:10.828140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:10.829061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:10.829863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:10.836562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 114/228] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:10.843122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:10.934060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5a5c9-7904-415d-b94b-d59cbfa1ad8e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:10.974318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ee3cd-bcf7-4a62-a45d-ffebb13c59f7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:11.018570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.020360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.020645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.020923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.021676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:11.021979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.023361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.027455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.028335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.028623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.028902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.030734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.032176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.033959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 115/229] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:11.043643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 115/230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:11.048154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:11.049107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:11.071119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:11.096920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:11.151431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8377c825-993c-41b9-857e-aafe70b2675c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:11.185029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.185900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.186183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.186459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.187652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.189166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.195892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 116/231] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:11 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:11.197068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:11.230124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a463e0-528a-4d2e-aa62-c861c8733c2c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:11.296825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7ec4f-0a28-436e-b18c-b6f7dd787c6e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:11.312502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:11.336285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.337249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.337533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.337808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/a914dda46b184ee88aab37538f75d6cb/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.344162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, user_id=a914dda46b184ee88aab37538f75d6cb, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.345694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92cb57-acbe-4305-9024-1c6263e4abb5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.351251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.352141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.352432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.352706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.355932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.357678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.359466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 117/232] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:11 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:11.365788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:11.456165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 116/233] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:11 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/a914dda46b184ee88aab37538f75d6cb/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:11.479819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bb8fd-7b07-492c-81ee-5586590f323f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:11.518641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:11.519533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:11.519865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:11.520161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/a914dda46b184ee88aab37538f75d6cb/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:11.522491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, user_id=a914dda46b184ee88aab37538f75d6cb, role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:11.524150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f77e9c-2c72-4b1b-bdc1-71d907be1772 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:11.643911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:11 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/a914dda46b184ee88aab37538f75d6cb/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:12.379052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2385-8407-48dd-866d-b2702f8281b2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.379587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2385-8407-48dd-866d-b2702f8281b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.379687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a2385-8407-48dd-866d-b2702f8281b2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.381041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 117/235] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:12.386289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.386749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.386836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.409664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:12.410853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:12.462008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:12.500963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b83-5246-401e-bdd9-828fe1349130 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.501298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b83-5246-401e-bdd9-828fe1349130 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.501531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f53b83-5246-401e-bdd9-828fe1349130 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.503598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 118/236] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:12.508991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.509436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 119/237] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:12.509811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.510289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.532845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:12.537150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:12.538356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:12.667247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea9f964-dc13-4214-9959-af79cf4a317d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:12.690365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 119/238] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:12.704654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:12.706076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.706359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.706627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.717155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:12.724927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:12.725810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:12.726588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 120/239] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:12.729015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:12.735995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:12.740641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:12.786956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:12.890978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece37a4-85fc-4ee1-a2d9-1aeee9758461 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:12.906023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bea368-f2a2-4fcf-921e-0b604c730a24 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:12.928695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:12.930096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.930589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.931080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.932959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:12.935089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe74ce-4a3c-410f-be5e-4577b51e0272 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:12.937984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 120/240] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:12.939476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83991fd-7d87-4c4c-ab27-4e93535d5941 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.940555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83991fd-7d87-4c4c-ab27-4e93535d5941 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.941053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83991fd-7d87-4c4c-ab27-4e93535d5941 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.942512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 121/241] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:12.944841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83991fd-7d87-4c4c-ab27-4e93535d5941 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:12.951980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:12.952681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.952965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.953238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.953988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:12.954294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:12.955713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca2005-a413-4ea4-8409-8dde614c68c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:12.965084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 121/242] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:12.966515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13673-6203-44b4-846b-617ba891e8db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:12.966803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13673-6203-44b4-846b-617ba891e8db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:12.967079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13673-6203-44b4-846b-617ba891e8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:12.985562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-43c13673-6203-44b4-846b-617ba891e8db None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:12.987421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43c13673-6203-44b4-846b-617ba891e8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:13.044031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.073092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 122/243] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:13.074514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c13673-6203-44b4-846b-617ba891e8db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.074971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83991fd-7d87-4c4c-ab27-4e93535d5941 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.107701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.116250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.117171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.117625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.118069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.118950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.128346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.188885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c13673-6203-44b4-846b-617ba891e8db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.199263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 122/244] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:12 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:02:13.200927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.241075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.242061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.242351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.242626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] PATH_INFO: `/v3/users/5405509251d34cb983092805a5bd92d7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.271714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] RBAC: Authorizing `identity:get_user(user_id=5405509251d34cb983092805a5bd92d7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.273397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.275557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 123/245] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/users/5405509251d34cb983092805a5bd92d7 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:13.282697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.336321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79d6d-eda8-4be2-90b5-a7a1736390e9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.375407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.379833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.381752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.382348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.382838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.396510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:13.406297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:13.407260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:13.408055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:13.411499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 123/246] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:13.417995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.478052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.502969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f322f86e-69f3-41da-b57c-cf666654edd0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.547429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.547907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.548229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.548507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.556162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0d9fd-8a17-4300-920c-643b178eaff9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.602576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.604375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.604874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.605615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.606851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:13.607764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.609420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.621034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 124/247] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:13.629197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.641222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.643263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.693145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.754960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab8d22-35f8-4261-91e7-8d3885bcd041 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.758438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.789840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 124/248] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:02:13.796867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.802321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.803411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.803837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.804283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] PATH_INFO: `/v3/users/6255e2afa0774adb9fb1a35aabbfc891` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.806888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] RBAC: Authorizing `identity:get_user(user_id=6255e2afa0774adb9fb1a35aabbfc891)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.808559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.811776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 125/249] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/users/6255e2afa0774adb9fb1a35aabbfc891 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:13.821347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.926893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b54bbd-1bbe-4038-a859-641a146310b4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.951042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45338d66-7cf2-40b3-8204-60c0c6a830c2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:13.971922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.973127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.973313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:13.973713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.974603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.976274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:13.978031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:13.980631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 125/250] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:13.987052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:13.994640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:13.995792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:13.996323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:13.997369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:13.998810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:14.000976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:14.008699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 126/251] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:14.011349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.070970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:14.128184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf288ca-36aa-4d0e-a06d-d6875c6b04ce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:14.142803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f8481d-16cb-421c-b80d-881b3684e080 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:14.164201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:14.165156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.165274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.165580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.166794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=5405509251d34cb983092805a5bd92d7) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:14.167161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:14.168875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54e6e4a-54ed-43dc-b4ee-9eaa28b46d7a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:14.176139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 126/252] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:13 2022] GET /identity/v3/role_assignments?user.id=5405509251d34cb983092805a5bd92d7&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=e85c6d9c982c48d5843351f798e7036b => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:14.180984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:14.181776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7fcb-3d8c-4b30-bb89-e25e50abc487 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.182069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7fcb-3d8c-4b30-bb89-e25e50abc487 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.182351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb7fcb-3d8c-4b30-bb89-e25e50abc487 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.182553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.182968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.183380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/6255e2afa0774adb9fb1a35aabbfc891/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.183810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 127/253] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:14.185738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, user_id=6255e2afa0774adb9fb1a35aabbfc891, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:14.187343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be9a81e-e0df-4d88-bf76-15fe94f00e11 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:14.191414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a10ce-d43d-4ad7-b698-8cf1bf6e9c07 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.191714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a10ce-d43d-4ad7-b698-8cf1bf6e9c07 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.192127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a10ce-d43d-4ad7-b698-8cf1bf6e9c07 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.193585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 128/254] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:14.194495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.194835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.195118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.215893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:14.217304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:14.266529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 127/255] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:14 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/6255e2afa0774adb9fb1a35aabbfc891/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:14.268180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.268664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.269141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.301212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 129/256] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:14.313238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:14.315265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:14.340294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.398492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:14.424555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:14.441847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 128/257] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:14.483179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.494262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c45e3-a136-481d-a2fc-393d8f1d90c2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:14.564973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:14.565810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.566098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.566378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.590180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:14.606441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:14.607380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:14.608215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 130/258] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:14.617160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.643335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773357d-7817-459b-ba1f-eb073fb76710 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:14.681083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:14.681994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.682313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.682553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.694380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:14.702927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:14.703833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:14.704717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 129/259] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:14.710586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.766845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca088b76-dd19-4c7b-8136-6c395b9d539b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:14.769396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:14.812478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:14.850405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:14.851088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:14.851368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:14.851640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:14.852881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:14.853303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:14.854623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:14.872044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 131/260] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:14.877632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:14.991356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf46d84e-c8b9-46f1-9133-3ca47490a4f3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.056878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4a6ed-a389-4a5d-8557-783a4c9f4a6f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.067583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.068595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.069077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.069609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:15.070563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:15.071081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:15.072757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:15.091515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 130/261] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:15.100495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:15.121678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.122695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.122979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.123251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:15.125523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:15.127557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:15.129734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 132/262] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:14 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:15.135593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:15.194230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:15.286356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:15.289434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cb2c7-031f-44e6-9157-0508377a00c7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.324404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.325618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.326098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.326586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] PATH_INFO: `/v3/users/a914dda46b184ee88aab37538f75d6cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:15.327909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03781d90-b3a8-41ec-be0a-5281c7f129d4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.328250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] RBAC: Authorizing `identity:get_user(user_id=a914dda46b184ee88aab37538f75d6cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:15.329903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:15.332655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 131/263] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:15 2022] GET /identity/v3/users/a914dda46b184ee88aab37538f75d6cb => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:15.342515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:15.397900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.398613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.398901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.399178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:15.527777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:15.529336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:15.589256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:15.594032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67200781-470b-452c-b7b4-35d91c7c3843 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.676821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.677487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.677779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.678061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:15.707551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 133/264] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:15.712916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:15.769766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:15.861256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:15.861256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:15.911069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b652b-0aba-4b9e-9685-34d7c1da8169 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:15.979356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:15.989704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:15.990686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:15.990964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:15.991232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.000138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:16.000138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:16.000138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 134/265] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:15 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:16.004654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:16.065652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 132/266] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:16.072346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:16.172224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:16.218825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad0f1d7-573b-4ebe-9a08-245c26d81dca None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:16.221434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e9936b-b953-49c1-bbc7-b15254efdb92 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:16.268257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:16.268921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.269201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.269476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.270315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=a914dda46b184ee88aab37538f75d6cb) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:16.270625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:16.272075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:16.281842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 135/267] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:16 2022] GET /identity/v3/role_assignments?user.id=a914dda46b184ee88aab37538f75d6cb&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:16.286381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:16.287280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.287567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.287844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.289193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:16.290714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf41120-6f19-47a9-af5f-8722e15308d6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:16.292869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 133/268] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:16 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:16.298768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:16.365441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:16.403733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba130-6afb-4edc-958d-e5184d14349e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:16.441255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:16.441833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.442118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.442390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.443248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=a914dda46b184ee88aab37538f75d6cb) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:16.443557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:16.445084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245590bb-1436-4a4d-b9ff-158820fe4fbe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:16.452269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 136/269] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:16 2022] GET /identity/v3/role_assignments?user.id=a914dda46b184ee88aab37538f75d6cb&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:16.554710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793edec-4b5b-4a88-ae60-91b54376dfc6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.555031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793edec-4b5b-4a88-ae60-91b54376dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.555270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793edec-4b5b-4a88-ae60-91b54376dfc6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.556838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 134/270] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:16.573548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5424f1-979f-40b6-8b4b-fc6530fa2cab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.574080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5424f1-979f-40b6-8b4b-fc6530fa2cab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.574080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5424f1-979f-40b6-8b4b-fc6530fa2cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.597670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b5424f1-979f-40b6-8b4b-fc6530fa2cab None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:16.598867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b5424f1-979f-40b6-8b4b-fc6530fa2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:16.687916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 137/271] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:16.719496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793edec-4b5b-4a88-ae60-91b54376dfc6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:16.852466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c61cd-cfec-499e-a864-df0d7dbe76cb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.852805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c61cd-cfec-499e-a864-df0d7dbe76cb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.853027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327c61cd-cfec-499e-a864-df0d7dbe76cb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.854938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 138/272] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:16.857432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793edec-4b5b-4a88-ae60-91b54376dfc6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:16.865403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.865689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.865973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.887182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:16.888415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:16.900632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:16.901757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:16.902225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:16.902672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:16.907965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:16.917851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:16.925814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:16.932888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:16.933730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 135/273] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:16.938648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:16.975531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:16.990743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 139/274] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:17.031112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.069615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fea35-cc37-4012-9a96-528fdefb811d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.112007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.113314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.114561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.115074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.116042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:17.116593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:17.118168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:17.129855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 136/275] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:17.137188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.155128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f13d0-d584-42c5-8312-48e1d3c1c337 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.197425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.197425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.197425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.197425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.197903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:17.197903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:17.200043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:17.200321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 140/276] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:17.204753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.242938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad02967-c156-44e0-9069-4948c2c7bcd5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.267304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:17.278867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.279753 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.280042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.281767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] PATH_INFO: `/v3/users/170c5cdc8a404168ba26320215019144` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.294209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] RBAC: Authorizing `identity:get_user(user_id=170c5cdc8a404168ba26320215019144)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:17.295730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63012-62b9-4547-9fcc-51497be6fe67 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:17.297458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 137/277] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/users/170c5cdc8a404168ba26320215019144 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:17.299354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff43c7-6635-4e4f-bd0d-795b447e0805 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.299703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff43c7-6635-4e4f-bd0d-795b447e0805 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.299983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff43c7-6635-4e4f-bd0d-795b447e0805 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.301425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 138/278] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:17.305604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834015c-c761-4833-8399-1fbfae5822d1 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.305904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834015c-c761-4833-8399-1fbfae5822d1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.306186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834015c-c761-4833-8399-1fbfae5822d1 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.307471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 139/279] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:17.308264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834015c-c761-4833-8399-1fbfae5822d1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.315065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7d569-6037-4f16-aa9f-b2cecbf420e9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.347358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.348021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.348330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.348604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.349300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:17.350741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77358419-1bc1-42d8-899c-569e2d9451b9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:17.407838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834015c-c761-4833-8399-1fbfae5822d1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.423634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:17.441061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.441710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.442044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.442274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.443106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, user.id=170c5cdc8a404168ba26320215019144, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:17.443420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:17.444903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf72d41-1aab-4e5d-863b-968bed4c5fce None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:17.448293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 141/280] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:17 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:17.449544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.449882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/role_assignments?user.id=170c5cdc8a404168ba26320215019144&scope.system=all&role.id=a07daedde46245149312ec8c706e6fef => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:17.451197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.451490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.451770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.460485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.460928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.470365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:17.471716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:17.516718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:17.519142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:17.573171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 141/282] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:17.599030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.650831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 142/283] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:17.677307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.734947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:17.794355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe4f5c-c9c4-4172-aa4c-3862e4652921 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.818774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:17.839798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcce9-588d-4fe4-9d96-7148852be6ce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:17.863778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.864717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.864998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.865275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.880289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:17.890652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:17.891614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:17.892483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 142/284] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:17.893657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:17.894986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:17.895377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:17.895747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:17.897918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:17.909984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:17.918941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:17.920051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:17.924965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 143/285] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:17.927527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.092141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f68960-b908-4f8d-b0c8-49cc45b07bbe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.140603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cb760-4661-4c16-aab4-845ee350d6b4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.142342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.161750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.165010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.165010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.165010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.165010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:18.165010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.165476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.184154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 143/286] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:18.187180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.206937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.207616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.207902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.208201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.208967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:18.209276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.210681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.230454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 144/287] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:18.235854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.251759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.376895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e96c36-5f0c-40ff-ab8a-560195c6a735 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.416656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.418261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.418779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.419158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] PATH_INFO: `/v3/users/6255e2afa0774adb9fb1a35aabbfc891` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.420740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] RBAC: Authorizing `identity:get_user(user_id=6255e2afa0774adb9fb1a35aabbfc891)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.422701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.424702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 144/288] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:18 2022] GET /identity/v3/users/6255e2afa0774adb9fb1a35aabbfc891 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:18.426908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c29a8-3938-4f40-8c92-7f7d3c8c51db None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.437373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.466734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.467605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.467884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.469318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] PATH_INFO: `/v3/users/5405509251d34cb983092805a5bd92d7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.471256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] RBAC: Authorizing `identity:get_user(user_id=5405509251d34cb983092805a5bd92d7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.472733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.474372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 145/289] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:18 2022] GET /identity/v3/users/5405509251d34cb983092805a5bd92d7 => generated 297 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:18.480670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.541657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.611214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577b37e-0136-4818-bda3-8f9decfbcd36 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.616136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6148409-614f-4d81-906b-b232ca1ebfe0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.632208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.653447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.654311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.654592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.654864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.657137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.658658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.661956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:18 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:18.667234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.682187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.682860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.683153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.683440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.778013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.779617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:18.827691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.833058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f3b7b-ebe5-4447-a211-f002c08acb29 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:18.916619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:18.917494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 145/291] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:18.918366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:18.918649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:18.918922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/5405509251d34cb983092805a5bd92d7/roles/e85c6d9c982c48d5843351f798e7036b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:18.920540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:18.922556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:18.926255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, user_id=5405509251d34cb983092805a5bd92d7, role_id=e85c6d9c982c48d5843351f798e7036b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:18.926963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:19.031156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:18 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/users/5405509251d34cb983092805a5bd92d7/roles/e85c6d9c982c48d5843351f798e7036b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:19.037224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db691c74-5c4f-4614-8da8-a43f6ff8b7df None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:19.088471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:19.089367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:19.089657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:19.089940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:19.091167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:19.092785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b76f7-2c01-4fba-af59-16e64eafe4a8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:19.094943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:18 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:19.101164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:19.262414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af26aa-d490-4fef-93ca-8f6052169af4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:19.300793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:19.301453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:19.301736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:19.302012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:19.302851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=6255e2afa0774adb9fb1a35aabbfc891) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:19.303163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:19.304632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b30ef-ac1d-4b4a-a020-ac2b54a2541e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:19.310634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:19 2022] GET /identity/v3/role_assignments?user.id=6255e2afa0774adb9fb1a35aabbfc891&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=a07daedde46245149312ec8c706e6fef => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:20.019347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e2-d0fc-4ccb-93dc-01e273f4a36b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.020360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e2-d0fc-4ccb-93dc-01e273f4a36b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.020870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8de3e2-d0fc-4ccb-93dc-01e273f4a36b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.022451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:20.027716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d59-d911-4972-a8a1-7ac05e0fb9ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.028510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d59-d911-4972-a8a1-7ac05e0fb9ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.029004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f670d59-d911-4972-a8a1-7ac05e0fb9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.040416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cb604-e4a4-4dc9-ae20-42846c979209 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.041319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cb604-e4a4-4dc9-ae20-42846c979209 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.041806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42cb604-e4a4-4dc9-ae20-42846c979209 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.043381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 148/296] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:20.044694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d30be-6eea-4f1a-bdbe-c99a50fee297 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.044976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d30be-6eea-4f1a-bdbe-c99a50fee297 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.045251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d30be-6eea-4f1a-bdbe-c99a50fee297 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.046593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 149/297] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:20.053006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f670d59-d911-4972-a8a1-7ac05e0fb9ee None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:20.053157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.053337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.053582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.054198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f670d59-d911-4972-a8a1-7ac05e0fb9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:20.072787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:20.073911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:20.075603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.128392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 149/298] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:20.137930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.138773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.139633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.140258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.144151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 150/299] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:20.150264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.164362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:20.165700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:20.237293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 150/300] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:20.238419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.260327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38423f-8b18-40a3-af9b-d156f850c485 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.296438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.297241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.297528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.297805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.299551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:20.301030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:20.302672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 151/301] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:20.303441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.341729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.357711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714fd3f2-73a1-45c5-8bb7-b58f1fdcd53d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.376799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.391802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.393164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.393446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.393718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.404826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:20.413771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:20.414650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:20.415438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:20.416348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931e46cc-d6b1-4146-92f8-bdf3b39a9514 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.420317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 151/302] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:20.421171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.449380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.450169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.450450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.450719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.461690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:20.469342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:20.470203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:20.471549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 152/303] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:20.472255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.537204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1460ec6-b5b2-40a3-a857-1479e21035be None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.571841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.572538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.572825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.573104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.573815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:20.574154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd09936-bf61-4c58-85c6-c640a4e4ab45 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.575276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:20.600088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.608229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.608895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.609182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.609459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.610201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:20.610508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:20.611889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:20.619997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 153/304] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:20.620803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.649250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 152/305] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Jul 12 18:02:20 2022] POST /identity/v3/groups => generated 229 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:20.650155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.653744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.761767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c477f-94da-451d-a47b-994fad647e8a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.803985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb1e2f5-42e7-46a7-bdab-1715af7c26c2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.812154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.812866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.813150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.813431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.814760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:20.815154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:20.816598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:20.832142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 154/306] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:20.834380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.860828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:20.861757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:20.862530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:20.862530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] PATH_INFO: `/v3/users/a0fa62d5efcf4509bc965bd0c119e26f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:20.881009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] RBAC: Authorizing `identity:get_user(user_id=a0fa62d5efcf4509bc965bd0c119e26f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:20.883294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:20.888589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 153/307] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/users/a0fa62d5efcf4509bc965bd0c119e26f => generated 293 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:20.891010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:20.908149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.960498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:20.973236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eb893c-ac88-4130-ac58-3b676c6a742b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:20.999781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c4780-dca0-457a-8fca-93a13b359fed None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:21.009727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.010965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.011433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.011846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] PATH_INFO: `/v3/users/170c5cdc8a404168ba26320215019144` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.013310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] RBAC: Authorizing `identity:get_user(user_id=170c5cdc8a404168ba26320215019144)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:21.015053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:21.022355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 155/308] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/users/170c5cdc8a404168ba26320215019144 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:21.023943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:21.037807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.038473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.038762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.039044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.039892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, user.id=a0fa62d5efcf4509bc965bd0c119e26f, scope.system=all) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:21.040257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:21.042089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ea0dd-b085-4a0e-9448-5c9fdeb04a55 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:21.047860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 154/309] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Jul 12 18:02:20 2022] GET /identity/v3/role_assignments?user.id=a0fa62d5efcf4509bc965bd0c119e26f&scope.system=all&role.id=e85c6d9c982c48d5843351f798e7036b => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:21.141929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62ee709-374f-4715-9e33-07235e59e328 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:21.161930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:21.180140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.181102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.182684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.182684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] PATH_INFO: `/v3/system/users/170c5cdc8a404168ba26320215019144/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.183673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=170c5cdc8a404168ba26320215019144, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:21.185258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:21.261764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbb94-6174-4615-a58e-1be82dfacc3d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.262079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbb94-6174-4615-a58e-1be82dfacc3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.262330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcbb94-6174-4615-a58e-1be82dfacc3d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.263845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 155/310] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:21.268453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.268741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.269013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.272404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 156/311] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Jul 12 18:02:21 2022] PUT /identity/v3/system/users/170c5cdc8a404168ba26320215019144/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:21.288087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:21.289348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:21.369447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 156/312] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:21.393377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:21.508607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2b12-4350-4024-ae25-028847430d17 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:21.543644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.544793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.545251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.545726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.556788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:21.564754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:21.565650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:21.566431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:21.568768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 157/313] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:21.574700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:21.631981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:21.676557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67511ab-d0cf-4793-8136-6b06b6fce70e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:21.710870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.711543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.711823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.712095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.712867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:21.713168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:21.714542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:21.723702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 157/314] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:21.729121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:21.775339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:21.843646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c535a-bb04-44c4-8a36-984d28a258fc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:21.883568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:21.884513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:21.884803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:21.885086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] PATH_INFO: `/v3/users/5405509251d34cb983092805a5bd92d7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:21.886301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] RBAC: Authorizing `identity:get_user(user_id=5405509251d34cb983092805a5bd92d7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:21.887807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:21.889543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 158/315] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:21 2022] GET /identity/v3/users/5405509251d34cb983092805a5bd92d7 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:21.895901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:21.996826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837f1f78-5f0d-4b7f-94fb-5dbf355d1f05 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:22.013659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:22.030319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:22.032748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:22.032748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:22.032748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:22.099252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:22.100895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:22.199260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 158/316] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:22.204789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:22.315634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971460b-9f9f-4108-9c43-ea96af7fe1b6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:22.326458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:22.351469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:22.352945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:22.352945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:22.353095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:22.354349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:22.355800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741ac1c-01f6-4f64-bfce-c55f220f05ec None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:22.357919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 159/317] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:22 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:22.363615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:22.382979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:22.465285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2177d1e-45be-4191-af9c-99b55b2ee39b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:22.500914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:22.502476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:22.502974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:22.503444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:22.504562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85, user.id=5405509251d34cb983092805a5bd92d7) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:22.505066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:22.506710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80906d6b-b6c9-4b43-816d-dd5b828eafc4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:22.513562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 159/318] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:22 2022] GET /identity/v3/role_assignments?user.id=5405509251d34cb983092805a5bd92d7&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=e85c6d9c982c48d5843351f798e7036b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:22.792490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc803a-a9de-4933-9175-eebdb0f48511 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:22.792825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc803a-a9de-4933-9175-eebdb0f48511 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:22.793020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc803a-a9de-4933-9175-eebdb0f48511 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:22.794485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 160/319] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:22.800312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235712-e54d-418c-8380-9dff312f3670 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:22.800607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235712-e54d-418c-8380-9dff312f3670 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:22.800885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60235712-e54d-418c-8380-9dff312f3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:22.820751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-60235712-e54d-418c-8380-9dff312f3670 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:22.821932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60235712-e54d-418c-8380-9dff312f3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:22.892582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 160/320] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:22.915025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc803a-a9de-4933-9175-eebdb0f48511 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.018049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc803a-a9de-4933-9175-eebdb0f48511 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.051758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.052584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.052877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.053149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.054302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:23.055747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec59f30-bca6-4dd1-a125-93cd1667029d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:23.057541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 161/321] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:23.062824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235712-e54d-418c-8380-9dff312f3670 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.076758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:23.160583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60235712-e54d-418c-8380-9dff312f3670 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.195086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.195758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.196036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.196336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.197032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:23.198468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:23.242735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6e7c5-fb5c-4bfe-bce1-13de2699647b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.243237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6e7c5-fb5c-4bfe-bce1-13de2699647b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.243319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6e7c5-fb5c-4bfe-bce1-13de2699647b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.244737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 162/322] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:23.249661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9514e-98c8-4b57-adef-587a314c7be3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.249946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9514e-98c8-4b57-adef-587a314c7be3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.250219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9514e-98c8-4b57-adef-587a314c7be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.267285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d1a9514e-98c8-4b57-adef-587a314c7be3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:23.268517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d1a9514e-98c8-4b57-adef-587a314c7be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:23.288513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 161/323] 10.222.0.33 () {60 vars in 1134 bytes} [Tue Jul 12 18:02:23 2022] POST /identity/v3/groups => generated 226 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:23.324866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:23.352207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 163/324] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:23.374914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.433469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f6b65-69d1-4b9a-b6ca-32e69eba03e4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.433784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f6b65-69d1-4b9a-b6ca-32e69eba03e4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.434035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f6b65-69d1-4b9a-b6ca-32e69eba03e4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.435424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 164/325] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:23.441125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.441420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.441699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.456641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:23.459465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:23.460709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:23.496072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48541b85-83af-49af-a971-956d3c51e0d2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.540614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.541692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.541974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.542299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.544271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 165/326] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:23.555346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:23.563060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:23.564205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:23.565516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 162/327] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:23.568431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.573593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.694994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b598df-4f65-43bb-b8b4-79648619766b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.702484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:23.705685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598b1b-c676-4898-905e-d288c58b4c5d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.735725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.737210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.737490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.737765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.742500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:23.747183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.747518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.747807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.748079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.751109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:23.753902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:23.753902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:23.754070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:23.762037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:23.763027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:23.763810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:23.764474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 163/328] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:23.764545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 166/329] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:23.769236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.771991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.900748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04028fab-c50e-4047-8c07-cce8c2342eda None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.914271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4806b16-3f85-4244-9669-4b7e54c35e02 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:23.953907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.954570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.954981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.955240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:23.955355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.956009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:23.956348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:23.956875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:23.957349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:23.957739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:23.958024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] PATH_INFO: `/v3/users/a0fa62d5efcf4509bc965bd0c119e26f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:23.959570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fa62d5efcf4509bc965bd0c119e26f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:23.961390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:23.963370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 164/330] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/users/a0fa62d5efcf4509bc965bd0c119e26f => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:23.968926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:23.970336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 167/331] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:23.981645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:24.020345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:24.052343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:24.110913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ee474-ea2c-49b4-9491-d9a5ed87f6c0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:24.125396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454f68e-5b83-40af-b846-4510f6a90b3d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:24.158511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:24.159730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:24.160559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:24.161043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] PATH_INFO: `/v3/system/users/a0fa62d5efcf4509bc965bd0c119e26f/roles/e85c6d9c982c48d5843351f798e7036b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:24.163981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a0fa62d5efcf4509bc965bd0c119e26f, role_id=e85c6d9c982c48d5843351f798e7036b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:24.165643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366381c0-9e0a-4d00-abed-f8053c757643 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:24.174344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:24.175493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:24.175493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:24.175656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] PATH_INFO: `/v3/users/170c5cdc8a404168ba26320215019144` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:24.177667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] RBAC: Authorizing `identity:get_user(user_id=170c5cdc8a404168ba26320215019144)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:24.179515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:24.182718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 168/332] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:23 2022] GET /identity/v3/users/170c5cdc8a404168ba26320215019144 => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:24.188699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:24.232284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 165/333] 10.222.0.33 () {58 vars in 1334 bytes} [Tue Jul 12 18:02:23 2022] PUT /identity/v3/system/users/a0fa62d5efcf4509bc965bd0c119e26f/roles/e85c6d9c982c48d5843351f798e7036b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:24.303075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:24.310175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69252628-78dd-4200-96dd-7ed3d9e6a39e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:24.348762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:24.349490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:24.349780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:24.350057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:24.351034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] RBAC: Adding query filter params (role.id=a07daedde46245149312ec8c706e6fef, user.id=170c5cdc8a404168ba26320215019144, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:24.351349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:24.353034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348a3ef-2fc4-4bd8-ad44-db1cd992f05e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:24.370520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 169/334] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Jul 12 18:02:24 2022] GET /identity/v3/role_assignments?user.id=170c5cdc8a404168ba26320215019144&scope.system=all&role.id=a07daedde46245149312ec8c706e6fef => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:25.990553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77329e-9944-4072-ba97-efd351155928 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:25.991056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77329e-9944-4072-ba97-efd351155928 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:25.991131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77329e-9944-4072-ba97-efd351155928 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:25.992730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 166/335] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:25.998183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:25.998617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:25.998791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.022548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:26.023797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:26.100256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 170/336] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:26.140494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77329e-9944-4072-ba97-efd351155928 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:26.258696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77329e-9944-4072-ba97-efd351155928 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:26.289649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:26.300483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:26.301313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.301599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.301876 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.320850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fac72729-36eb-4178-b1d9-f1e9fd16a903 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:26.329184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:26.330284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:26.331066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 167/337] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:26.339531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:26.349326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676175b3-e993-4d3b-9436-2402fddb2ef8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.349605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676175b3-e993-4d3b-9436-2402fddb2ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.349882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676175b3-e993-4d3b-9436-2402fddb2ef8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.355183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 168/338] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:26.359533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6badc8-e4d1-405f-b79e-ad685c1b95ef None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.359819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6badc8-e4d1-405f-b79e-ad685c1b95ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.360092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6badc8-e4d1-405f-b79e-ad685c1b95ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.396468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc6badc8-e4d1-405f-b79e-ad685c1b95ef None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:26.397678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc6badc8-e4d1-405f-b79e-ad685c1b95ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:26.516434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:26.536351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67de3f8-6161-444c-a031-5b5f9a09f607 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:26.541706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 169/339] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:26.586274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:26.587256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.587749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.588237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.589167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:26.589653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:26.591240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:26.596183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8642924-d99a-4b5a-91ea-e22b072e512d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.596183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8642924-d99a-4b5a-91ea-e22b072e512d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.596183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8642924-d99a-4b5a-91ea-e22b072e512d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.600578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 170/340] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:26.601830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.602308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.602653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.611944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 171/341] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:26.613040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:26.627392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:26.628713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:26.736912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bce8dc-f248-4c89-a5d2-5a856d18cb79 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:26.739223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 171/342] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:26.742300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:26.803941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:26.804764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.805048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.805321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:26.832668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:26.833538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:26.848030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:26.850810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:26.851598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 172/343] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:26.852758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:26.868953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:26.938488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66285f77-47fe-472d-ab8a-1b5915b1f647 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:26.981748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:26.982813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:26.983295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:26.983770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.067639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.070034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.080559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897f411-6aef-4fc6-8c03-750e8509a259 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.129145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.160628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.161443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.161728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.162005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.184802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:27.193245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:27.194198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:27.195082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:27.197216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 173/344] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:27.203724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:27.229520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 172/345] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:27.230385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:27.332202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.371235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c323787-a031-408a-adaa-c6d0407cbd3f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.377972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970caf45-e2fd-4a86-951a-fb74ca6a1c6b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.412931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.413525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.413810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.414111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.414866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:27.415172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.416838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.427804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 174/346] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:27.428373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.428700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:27.429578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.434318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.434318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.434318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:27.434318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.435148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db95a522-e0e6-4c87-853a-f8be87546ba4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.448081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 173/347] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:27.449962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f25-429a-4b41-9943-63672fb41455 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.450453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f25-429a-4b41-9943-63672fb41455 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.451097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0796f25-429a-4b41-9943-63672fb41455 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.453515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 174/348] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:27.454439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796f25-429a-4b41-9943-63672fb41455 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:27.467582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.563925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc50cb-a4a8-4e70-babb-e15fcbf6236d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.574527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0796f25-429a-4b41-9943-63672fb41455 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.598366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.610450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.612322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.612919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.613483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.616724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.616843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.616961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.617035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.617103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.617356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.619258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 175/349] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:27.622452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:27.715418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.717375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee2343-c3ae-4284-87d4-8e70b0e8d3c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.728964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.751112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871df6b4-375a-493d-91b6-1ff45291a425 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:27.794837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:27.795518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.796151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.796151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.858222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 175/350] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:27.859649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6869-5e93-46cc-866f-83a335b06920 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.860086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6869-5e93-46cc-866f-83a335b06920 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.864476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6869-5e93-46cc-866f-83a335b06920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.884723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:27.886825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e5a6869-5e93-46cc-866f-83a335b06920 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:27.888020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e5a6869-5e93-46cc-866f-83a335b06920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:27.891793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:27.894274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:27.973382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 176/351] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:27.975112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaaa36-25e0-4f77-a359-582808485360 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:27.975599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaaa36-25e0-4f77-a359-582808485360 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:27.976079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eaaa36-25e0-4f77-a359-582808485360 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:27.977821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 177/352] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:27.978814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaaa36-25e0-4f77-a359-582808485360 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.030941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 176/353] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:28.031549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.032055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.103183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eaaa36-25e0-4f77-a359-582808485360 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.151781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.152694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.152976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.153249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.159410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.160913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a083c0-a82d-4b1c-b230-b45a09eced81 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.163713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 178/354] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:27 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.163840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.164554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.164841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.165204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.170964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c24b8-b1d8-4bd7-8747-09bb8e3b2924 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.184165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:28.184165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:28.209306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.210173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.210454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.210729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.212005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.213777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.215528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 177/355] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.216383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.263646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 179/356] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:28.264814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.303623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.339541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f023b8-f845-408d-b4b1-209e7b647ba1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.381454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.382365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.382687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.382977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.384847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633cdd1-f24c-4aa1-8ca3-c48de6fa2fd3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.397056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-703e86e5-4e88-4ec9-82b8-8d6a7efb581e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:28.405173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:28.406067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:28.407461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 178/357] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:28.409028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbec83-4701-4a59-bfed-f5f118225f0b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.409028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbec83-4701-4a59-bfed-f5f118225f0b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.409028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efbec83-4701-4a59-bfed-f5f118225f0b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.410426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 179/358] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:28.410989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbec83-4701-4a59-bfed-f5f118225f0b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.428686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.429559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.429851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.430121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.431315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.432912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.439001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 180/359] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.439001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.447517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.540752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efbec83-4701-4a59-bfed-f5f118225f0b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.555050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.559489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f11423-0ae7-4846-8195-7e8c365856e1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.589483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.589680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.589912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.590148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.591347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=a84ac953b4694932bf393a1817f5e085) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:28.591347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.592815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.595895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.596844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.597792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.598600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.599805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.608141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 180/360] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.608141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.608413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.608413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 181/361] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.608413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.735086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.747831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48027794-9890-437c-acd4-acb99d6e5759 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.755271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c516bc-3e13-41ac-8610-46c6030ca239 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.791997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.792660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.792943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.793346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.794438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:28.794753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.796623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e1e2cb-6a8d-4192-96a1-e292ca16e120 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.803281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.804851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.804851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.804851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.806133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 182/362] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:28.810282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.810282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.810282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.823041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:28.832421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:28.833356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:28.834156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 181/363] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:28.834826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.836305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:28.837656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:28.868778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:28.932862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 183/364] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:28.940236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:28.952776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e548d-4527-4ee3-9c24-f60e7a9a1e0c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:28.989900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:28.990886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:28.991193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:28.991594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:28.996368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:28.997963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:28.999921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 182/365] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.000576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.023426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.049315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe5f5a-cce7-4d4a-ab32-7daf5c6999db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.093455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.094120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.094407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.094689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.095567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=a84ac953b4694932bf393a1817f5e085) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:29.095883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.098202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.108299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 184/366] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=a07daedde46245149312ec8c706e6fef => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.110011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.124199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c4ad9-edae-4e6d-9e6f-4a9b794a18a6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.151733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.170708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.172048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.172609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.173097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.256267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.258800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.259378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae3cf0-ca6e-4a18-9b8c-4e808732b071 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.283159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.312867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.313950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.314750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.315033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.315800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:29.316109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.318058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.328904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 185/367] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.330839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.394408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 183/368] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:29.395606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.436407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.455329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cb118-8264-43ed-ad6a-53c393d6288f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.501070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.502686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.503465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.503850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.517030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:29.517680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec3d37-9939-4bfe-9bfb-65b5ed2a834d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:29.526200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:29.527127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:29.527912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 186/369] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:29.528639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.549018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.574172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.575014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.575408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.575818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.576944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:29.577261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.579392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.586930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 184/370] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=a07daedde46245149312ec8c706e6fef => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.587757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.708196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed30aa87-35f5-41e8-a426-5b13b253ce4c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.722603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ab746-83ed-44ee-8da4-111c1483c572 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.746575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.747455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.747742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.748018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.749887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.751551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.753686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 185/371] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.754561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.764630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.765535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.765821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.766100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] PATH_INFO: `/v3/users/a0fa62d5efcf4509bc965bd0c119e26f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.767446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] RBAC: Authorizing `identity:get_user(user_id=a0fa62d5efcf4509bc965bd0c119e26f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.768953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.770953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 187/372] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/users/a0fa62d5efcf4509bc965bd0c119e26f => generated 293 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.771746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.790067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.836603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:29.879089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085aa7e-e8ab-4028-afb4-abcb76ac5d29 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.937019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef426-a9c8-4868-b7e8-b4cb3de11109 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:29.950635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.951378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.951667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.951945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.952783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:29.953268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.955932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.971386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 186/373] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.972271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:29.990811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:29.992207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:29.992499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:29.992779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:29.993970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:29.995435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:29.997231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 188/374] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:29.998399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:30.096664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:30.109937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f73eb-941b-4479-ad3f-39a6528d775d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:30.146474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:30.147136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:30.147426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:30.147712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:30.239337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d37f36-b17b-4754-b029-2c4e95426d95 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:30.249038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:30.250514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:30.259750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:30.336469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:30.355533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 189/375] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:30.356391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:30.376848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:30.377537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:30.377827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:30.378112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:30.378975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] RBAC: Adding query filter params (role.id=e85c6d9c982c48d5843351f798e7036b, user.id=a0fa62d5efcf4509bc965bd0c119e26f, scope.system=all) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:30.379295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:30.380782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:30.418473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 187/376] 10.222.0.33 () {56 vars in 1308 bytes} [Tue Jul 12 18:02:29 2022] GET /identity/v3/role_assignments?user.id=a0fa62d5efcf4509bc965bd0c119e26f&scope.system=all&role.id=e85c6d9c982c48d5843351f798e7036b => generated 510 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:30.419348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:30.531257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f275e68-5055-4a28-9db4-296884831426 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:30.617013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:30.617617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:30.617906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:30.618182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:30.619041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:30.619354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:30.620859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:30.640395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513bcfd-f6f0-4207-b7a2-86407b52bafc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:30.640998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 190/377] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:30 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:30.695853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:30.696765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:30.697047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:30.697320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] PATH_INFO: `/v3/projects/71b4b41640174f02914b235b985edf53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:30.700934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] RBAC: Authorizing `identity:get_project(project_id=71b4b41640174f02914b235b985edf53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:30.702399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:30.705294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 188/378] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:30 2022] GET /identity/v3/projects/71b4b41640174f02914b235b985edf53 => generated 344 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:30.710947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:30.784543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:30.870597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca01bc-316e-4e86-b597-658c0b996d58 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:30.914906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:30.916029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:30.916364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:30.916643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] PATH_INFO: `/v3/groups/a974177df1114313b4c2ee6c10949737` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:30.921578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] RBAC: Authorizing `identity:get_group(group_id=a974177df1114313b4c2ee6c10949737)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:30.923034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf52f-64da-479b-9c2e-1131c2b7a69e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:30.925547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 191/379] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:30 2022] GET /identity/v3/groups/a974177df1114313b4c2ee6c10949737 => generated 229 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:30.931216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:30.983572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:31.017601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8771d9-9231-4907-8e57-ae158ff2a1e2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.018169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8771d9-9231-4907-8e57-ae158ff2a1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.018682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8771d9-9231-4907-8e57-ae158ff2a1e2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.021405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 192/380] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:31.027924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.028542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.029049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.057166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:31.058650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:31.082568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03af010-0ca4-41a7-af8b-954853ced5bf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:31.149771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:31.150364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.150654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.150936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.151789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] RBAC: Adding query filter params (group.id=a974177df1114313b4c2ee6c10949737, role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=71b4b41640174f02914b235b985edf53) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:31.152109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:31.156066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:31.169920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 189/381] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:30 2022] GET /identity/v3/role_assignments?group.id=a974177df1114313b4c2ee6c10949737&scope.project.id=71b4b41640174f02914b235b985edf53&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:31.184582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 193/382] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:31.217897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:31.359338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:31.364738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee474db1-23a1-4458-a9a8-3b691a1e6c36 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:31.401071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:31.401820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.402112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.402391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.425129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-070c0f37-a6fb-4752-98f1-ecd8222a4802 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:31.434223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:31.435161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:31.435952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 190/383] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:31.443421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:31.500671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:31.570394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68380d96-b427-478c-9bbc-3ae0282ad5fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:31.622604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2d43-7970-4181-8b50-d823dca74f63 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.622922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2d43-7970-4181-8b50-d823dca74f63 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.623173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f2d43-7970-4181-8b50-d823dca74f63 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.624722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 191/384] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:31.625473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:31.626149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.626467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.626743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.627511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:31.627818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:31.629258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:31.641186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.641472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.641754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.649648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 194/385] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:31.659006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:31.667712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:31.668954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:31.831070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 192/386] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:31.850560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ae245-d1fb-4957-973c-660887a080d4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:31.852434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:31.874347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:31.916836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:31.918120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:31.919602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:31.920101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:31.922655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:31.927307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:31.932795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 195/387] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:31 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:31.939991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.052825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:32.069555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30195769-b99c-4142-95d5-e652d55bcff2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.092757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a6a71-0cea-4064-8d5c-ab7e4e0d48c9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.131231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.132812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.133775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.134576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.135084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.136077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.137132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.137969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:32.138453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.140086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:32.142540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 196/388] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:31 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:32.148013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.163874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:32.172192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:32.173069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:32.174459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:32.186945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 193/389] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:32.191991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.222016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:32.289422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c5941-fbc4-49a0-9acc-4c2ee6503870 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.332012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.334444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.334932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.335405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.337976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:32.340424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09814eb4-4309-47ea-884a-e5c42e756bc2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:32.366046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefd3b9-b4ff-4e47-b000-d81c0c8ac9bc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.400758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.401510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.401818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.402107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.402910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] RBAC: Adding query filter params (name=member) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:32.403245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:32.404744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:32.412597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 197/390] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Jul 12 18:02:32 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:32.414300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 194/391] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:32.414566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5cc-383e-45e6-b9ee-e7312d586904 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.414934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5cc-383e-45e6-b9ee-e7312d586904 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.415369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd5cc-383e-45e6-b9ee-e7312d586904 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.417451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 198/392] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:32.426328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.429649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.430214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.437287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.462033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:32.463681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:32.464272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:32.616399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 199/393] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:32.630693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560aa999-0a24-45e5-be0b-d318b7d64a09 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.654476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.685633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.686809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.687186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:32.687400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.688060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.692820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:32.694371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:32.696702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 195/394] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:32 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:32.701550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.774305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2aa2d5-1759-4ba9-adb7-2a58ec58e2c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.813647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:32.815580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:32.816093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:32.816587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:32.830139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:32.838530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:32.839414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:32.840280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:32.843142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 200/395] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:32.849790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:32.902617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:32.943089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d9f26-590c-4041-8d83-036df9d3ab6a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:32.987755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:33.002143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24f56c-073e-45c5-a5e0-f11af334f507 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.011367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.012562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.013017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.013443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.016569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.018831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.021181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 196/396] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:32 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:33.026326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.076849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.077532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.077813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.078086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.078846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:33.079150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.080613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.103339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 201/397] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:33.109210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.143433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b4eec-c3eb-4b53-bea1-40cd81e65d67 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.183096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.184547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.185092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.185582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.187867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] RBAC: Authorizing `identity:create_grant(project_id=a84ac953b4694932bf393a1817f5e085, group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.190568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e0d1a-805d-4ef5-8645-ea5994dcd146 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.274139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 197/398] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Jul 12 18:02:33 2022] PUT /identity/v3/projects/a84ac953b4694932bf393a1817f5e085/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:02:33.275226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139d7ab-823c-4384-a1b3-fb1bb2e61699 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.282083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffe26-2653-4049-be52-73f3d8aebeb7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.282083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffe26-2653-4049-be52-73f3d8aebeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.282083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ffe26-2653-4049-be52-73f3d8aebeb7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.282911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 198/399] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:33.300696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587cb3-df73-4654-9496-680c83138999 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.300997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587cb3-df73-4654-9496-680c83138999 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.301259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56587cb3-df73-4654-9496-680c83138999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.319374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.320320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.320579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.320959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.331238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.331238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.331238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 202/400] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:33 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:33.332559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-56587cb3-df73-4654-9496-680c83138999 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:33.333877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56587cb3-df73-4654-9496-680c83138999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:33.336171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:33.340021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.372723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:33.477357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 199/401] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:33.502599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587cb3-df73-4654-9496-680c83138999 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.507948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69435c93-57ce-477e-a3c9-2d465ff15778 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.551820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.553277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.553997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.554280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.555867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.558141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.561072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 203/402] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:33 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:33.567079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.621594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56587cb3-df73-4654-9496-680c83138999 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.660074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.661021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.661302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.661576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.665552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:33.671437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:33.676987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:33.682938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f833b-5600-4296-a37c-fb9331d37e71 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c1388699-4a94-4837-b41c-e31ecb3d6609 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:33.687835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:33.688757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:33.690042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 200/403] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:33.693487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511651-24b4-454e-bf6a-38d95b502649 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.693487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511651-24b4-454e-bf6a-38d95b502649 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.693487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b511651-24b4-454e-bf6a-38d95b502649 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.693847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 201/404] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:33.695391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511651-24b4-454e-bf6a-38d95b502649 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:33.729108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.730179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.730789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.731128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.734445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.737054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fc0b98-637e-44cd-b58e-da841c20d3ff None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.820218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b511651-24b4-454e-bf6a-38d95b502649 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:33.843741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 204/405] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Jul 12 18:02:33 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:33.846044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.846341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.849005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.869069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:33.871094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:33.871486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:33.873389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:33.874282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:33.874607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:33.879618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:33.888397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:33.894902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:33.895876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 202/406] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:33.901991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.009270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.035694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 205/407] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:34.059348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.063218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28445bae-2317-4211-a60e-d63a82900b14 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.100344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26961094-66da-417e-8864-4412e0f70143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.101130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961094-66da-417e-8864-4412e0f70143 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.101549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961094-66da-417e-8864-4412e0f70143 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.101834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26961094-66da-417e-8864-4412e0f70143 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.103128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26961094-66da-417e-8864-4412e0f70143 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.104661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26961094-66da-417e-8864-4412e0f70143 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.106660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 203/408] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:33 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:34.118411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26961094-66da-417e-8864-4412e0f70143 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.156155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.181132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ad146-609e-4a46-8340-c58a6dfd2fea None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.219052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.220238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.220690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.221180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.237145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:34.246461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:34.247373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:34.248248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 206/409] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:34.254623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.276761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26961094-66da-417e-8864-4412e0f70143 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.312745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.316537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.317802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.318315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.318795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.320240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.322562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.325094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 204/410] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:34.335527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.458740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602d5de-1a71-4bd4-be08-8246c55916ca None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.507493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49ba2-8a1d-4e92-873d-0b190a4994d7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.521755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.522434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.522720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.524255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.525028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:34.525340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.526750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.538861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.549214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 207/411] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:34.554552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.560426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.561327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.561617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.561901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.564837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] RBAC: Authorizing `identity:create_grant(project_id=0ce3f01e80f84bb098cb59d81701ac85, group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.566356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a198193-69e2-4be9-8b5c-4f141648c940 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.642904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 205/412] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Jul 12 18:02:34 2022] PUT /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:34.694501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af6ae28-77c3-4e8b-9868-1be2e8ffd921 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.712958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e924-bcb7-4b1d-9dea-47d78f635ef6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.713577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e924-bcb7-4b1d-9dea-47d78f635ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.714052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86e924-bcb7-4b1d-9dea-47d78f635ef6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.717083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 206/413] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:34.721547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.722073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.722568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.732551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.733443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.733732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.734012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] PATH_INFO: `/v3/groups/a974177df1114313b4c2ee6c10949737` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.737316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] RBAC: Authorizing `identity:get_group(group_id=a974177df1114313b4c2ee6c10949737)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.737432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.740171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 208/414] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/groups/a974177df1114313b4c2ee6c10949737 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:34.745214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.746005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:34.747436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:34.857707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.872489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:34.875987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 207/415] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:34.900450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:34.914251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41943c28-60d9-4438-b1ab-2fb656261044 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:34.959802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:34.961034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:34.961361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:34.961638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] PATH_INFO: `/v3/projects/71b4b41640174f02914b235b985edf53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:34.963353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] RBAC: Authorizing `identity:get_project(project_id=71b4b41640174f02914b235b985edf53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:34.965140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:34.967679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 209/416] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/projects/71b4b41640174f02914b235b985edf53 => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:34.975504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:35.041131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e97b1-c12c-4626-8447-d6ee58401ad9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:35.105491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:35.106312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.106599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.106872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.127259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:35.135462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:35.136360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:35.137176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:35.142340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 208/417] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:35.147094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b86a36-a98c-47d3-8419-637899937b25 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:35.149369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:35.210884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:35.211777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.212060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.212364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] PATH_INFO: `/v3/projects/71b4b41640174f02914b235b985edf53/groups/a974177df1114313b4c2ee6c10949737/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.218676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] RBAC: Authorizing `identity:create_grant(project_id=71b4b41640174f02914b235b985edf53, group_id=a974177df1114313b4c2ee6c10949737, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:35.220660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238e6d-0029-4a51-90df-4d3b4e43050d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:35.223303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:35.231002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:35.286191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77212229-ec3c-43f0-9506-2f2e480d2d52 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:35.321916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:35.322650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.322944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.323227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.324092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:35.324436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:35.325833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:35.335048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 209/418] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:35.341318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:35.367118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 210/419] 10.222.0.33 () {58 vars in 1442 bytes} [Tue Jul 12 18:02:34 2022] PUT /identity/v3/projects/71b4b41640174f02914b235b985edf53/groups/a974177df1114313b4c2ee6c10949737/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:35.475053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd819e-a3d2-49f3-84c9-36c3a73a706a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:35.500491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:35.515725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:35.516500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.517228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.517565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.601018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:35.602483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:35.700848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a75b-53bd-494c-9da5-b3a77834286f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.701910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a75b-53bd-494c-9da5-b3a77834286f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.702400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b2a75b-53bd-494c-9da5-b3a77834286f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.704943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 211/420] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:35.712186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 210/421] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:35.713778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.714068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.714345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.721761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:35.736681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:35.742328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:35.743548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:35.893764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 212/422] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:35.909599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5a12-0394-4636-81a2-00b4b3296ed2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:35.933084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:35.957022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:35.957890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:35.958175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:35.958450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:35.959654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:35.961143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:35.963163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 211/423] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:35 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:35.968710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.057079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:36.079413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee83f3a-cc7c-4024-8789-c3897c0032b1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.110356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55933d5e-2362-4b2a-adad-716b368a1ec3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.140587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:36.152513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.160093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.160093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.160093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.162504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.163372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.163658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.163936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.165313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:36.167092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:36.169267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 212/424] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:35 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:36.178416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.181774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:36.196141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:36.197081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:36.197910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:36.208064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 213/425] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:36.210238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.368906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5625e-4ef9-43df-8788-1eae2e3fc4cb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.379061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa006a-296a-4aea-8b86-1de30e9e9b29 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.432891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.434726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.435511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.436004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.436856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.437319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.438341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=a84ac953b4694932bf393a1817f5e085) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:36.439433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.439916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:36.441552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:36.442021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.442952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:36.443446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:36.445009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8484ec-0bb3-4155-b708-1429a31f0075 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:36.460266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 213/426] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 611 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:36.464459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 214/427] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:36.470842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.484509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:36.619150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493b518-bdb6-428a-8059-e6fc9800ed5d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.627942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff65f-b647-4212-a302-687e01492d69 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.628258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff65f-b647-4212-a302-687e01492d69 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.628539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bff65f-b647-4212-a302-687e01492d69 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.630187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 215/428] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:36.635051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.635338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.635614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.658581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:36.659774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:36.668638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.669354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.669641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.669918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.709582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:36.741746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 216/429] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:36.748623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:36.750102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:36.760204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:36.765419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.884347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 214/430] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:02:36.885678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.890703 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d34767-5582-40bb-abd1-5b77421c77c5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.928847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:36.929741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:36.930023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:36.930291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:36.941756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:36.950109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:36.951021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:36.951814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 217/431] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:36.958009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:36.990407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9045c9-9f3b-475c-9f5b-37c6e8ddcb9d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:36.996192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.000138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.025183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.026160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.026506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.026846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] PATH_INFO: `/v3/projects/a84ac953b4694932bf393a1817f5e085` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.028099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] RBAC: Authorizing `identity:get_project(project_id=a84ac953b4694932bf393a1817f5e085)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.029669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.036543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 215/432] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/projects/a84ac953b4694932bf393a1817f5e085 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:37.037749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.065853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5309a-79e7-4642-b62f-ea9e36cc52fe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.103619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.104385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.104668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.104940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.105688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:37.105998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.107595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bced5dbe-b3fd-4303-9d20-c132cc8126d5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.120781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 218/433] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:37.121872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bead14-fda4-430b-bd29-a01d97128040 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.122163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bead14-fda4-430b-bd29-a01d97128040 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.122489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bead14-fda4-430b-bd29-a01d97128040 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.127561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 219/434] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:37.127561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bead14-fda4-430b-bd29-a01d97128040 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.140710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d18560-d11b-4d3b-ace8-0adda0efa19c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.177188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.178047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.178328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.178594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.179766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.181250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e4bac-9730-4149-b45a-2624057c40b2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.182882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 216/435] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:37.184106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.184474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.184757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.202913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:37.204101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:37.240529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.245766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bead14-fda4-430b-bd29-a01d97128040 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.247137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.274884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 217/436] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:37.280439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.291812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.292971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.293851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.294130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.369176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.371068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.377558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac208a9a-2a81-47dd-8621-ee6087e495dc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.414466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.415027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.415310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.415588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.416713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=a84ac953b4694932bf393a1817f5e085) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:37.417023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.418456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.424532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 218/437] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=a84ac953b4694932bf393a1817f5e085&role.id=a07daedde46245149312ec8c706e6fef => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:37.425328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.484811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.502780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.509244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 220/438] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:37.514695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.572903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6479d5f-4f2f-40de-9795-f52b559d1867 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.620136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.620956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.621242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.621519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.637247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:37.639870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11d3fb-3479-4050-9ae6-28f45cd09906 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:37.645484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:37.646559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:37.647502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 219/439] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:37.653289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.682777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.683600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.683884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.684188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.685383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.686908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.693434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 221/440] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:37.695100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.778198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.781874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d3fe55-b39c-4254-99b5-06ab5e036f9e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.783195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:37.822778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.823686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.823975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.824288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.825053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:37.825886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.826737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c109ec-fba7-478a-91ac-6781db7bb627 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.826828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1568b02c-b9ac-418d-abf1-bf0fbef1792e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.838010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 220/441] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:37.839404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea9d8-cc96-45c3-a2bf-cda3caa8163c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.839698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea9d8-cc96-45c3-a2bf-cda3caa8163c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.839978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bea9d8-cc96-45c3-a2bf-cda3caa8163c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.841468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 221/442] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:37.843210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bea9d8-cc96-45c3-a2bf-cda3caa8163c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:37.873847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:37.874703 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.874984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.875262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.877079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:37.878523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1db561-f14c-49d7-a1ff-83fecca38fb7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:37.880198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 222/443] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:37.881497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:37.881790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:37.882069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:37.900051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:37.901277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:37.962757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bea9d8-cc96-45c3-a2bf-cda3caa8163c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:37.982935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 223/444] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:37.984022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.001425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.002082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.002375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.002660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.036433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.055591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.077110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.078581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.092390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29dc0b-7c17-4015-9654-5cb474b50447 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.125983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.126689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.126975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.127253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.128085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=a07daedde46245149312ec8c706e6fef, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:38.128425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.129856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.144375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 224/445] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=a07daedde46245149312ec8c706e6fef => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:38.144375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.200174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 222/446] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:02:38.202614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.248203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47686f77-3dff-4d10-8bd0-daa87c188099 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.280088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.283586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.291054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.294591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.294591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.294591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.303352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:38.312137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:38.313055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:38.314442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 225/447] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:38.319681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.331037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f13b8d-b0e4-4a13-a540-9ddfe12864c9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.369423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.370582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.370867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.371136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] PATH_INFO: `/v3/projects/0ce3f01e80f84bb098cb59d81701ac85` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.372519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] RBAC: Authorizing `identity:get_project(project_id=0ce3f01e80f84bb098cb59d81701ac85)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.374659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.377308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 223/448] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/projects/0ce3f01e80f84bb098cb59d81701ac85 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:38.382259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.442588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cfd97-0d92-42d2-a6e9-914f3efff2cf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.481691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.482368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.482660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.482940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.483697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:38.484006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.485977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.494639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 226/449] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:38.500212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.501947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18c61-af63-4714-ae9d-29ec91dbae70 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.535643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.546321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.547556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.548646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.549081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] PATH_INFO: `/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.550853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] RBAC: Authorizing `identity:get_group(group_id=3ef8ff4c6e954b3e88cff7c5d2ee61ee)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.552876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.553339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.559710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 224/450] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/groups/3ef8ff4c6e954b3e88cff7c5d2ee61ee => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:38.561609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.602107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db9855-9f64-4671-bca1-6a13cf897221 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.635058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.635697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.635978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.636279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.659165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2d767-4001-4596-8c0a-ee4ebb3f123e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.692704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.693355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.693644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.693925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.694760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] RBAC: Adding query filter params (group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee, role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=0ce3f01e80f84bb098cb59d81701ac85) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:38.695137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.696615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.701445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.702416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 225/451] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/role_assignments?group.id=3ef8ff4c6e954b3e88cff7c5d2ee61ee&scope.project.id=0ce3f01e80f84bb098cb59d81701ac85&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:38.702979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.754263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.806702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 227/452] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 18:02:38.812746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:38.878787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:38.926359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8433312-5b9d-4831-abf3-04da344c971b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:38.960510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:38.961372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:38.961654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:38.961932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] PATH_INFO: `/v3/projects/71b4b41640174f02914b235b985edf53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:38.963104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] RBAC: Authorizing `identity:get_project(project_id=71b4b41640174f02914b235b985edf53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:38.964602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:38.966287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 226/453] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/projects/71b4b41640174f02914b235b985edf53 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:38.972470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:39.071967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9a9f0-7e82-4ec2-96a3-522695731a52 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:39.103229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:39.104062 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:39.104369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:39.104642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] PATH_INFO: `/v3/groups/a974177df1114313b4c2ee6c10949737` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:39.105777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] RBAC: Authorizing `identity:get_group(group_id=a974177df1114313b4c2ee6c10949737)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:39.107204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dd463-8f6d-4a5c-81b0-488f6fed46c3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:39.108831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 228/454] 10.222.0.33 () {56 vars in 1180 bytes} [Tue Jul 12 18:02:38 2022] GET /identity/v3/groups/a974177df1114313b4c2ee6c10949737 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:39.115230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:39.211177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6775-c126-4196-a1ff-d2cb195964a1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:39.236569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:39.243636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:39.244312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:39.244596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:39.244868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:39.245693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] RBAC: Adding query filter params (group.id=a974177df1114313b4c2ee6c10949737, role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=71b4b41640174f02914b235b985edf53) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:39.246000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:39.247418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814bac8-6ee3-45de-8d1c-8b88fdff1e1c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:39.253501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 227/455] 10.222.0.33 () {56 vars in 1376 bytes} [Tue Jul 12 18:02:39 2022] GET /identity/v3/role_assignments?group.id=a974177df1114313b4c2ee6c10949737&scope.project.id=71b4b41640174f02914b235b985edf53&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:41.611392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb032ab-a0e9-4ec0-b57f-bef21c703272 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:41.611905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb032ab-a0e9-4ec0-b57f-bef21c703272 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:41.612012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb032ab-a0e9-4ec0-b57f-bef21c703272 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:41.613634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 229/456] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:41.619009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0eae-27db-42ab-990a-d77189fa75ff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:41.619410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0eae-27db-42ab-990a-d77189fa75ff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:41.619597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0eae-27db-42ab-990a-d77189fa75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:41.641029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a93d0eae-27db-42ab-990a-d77189fa75ff None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:41.642765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a93d0eae-27db-42ab-990a-d77189fa75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:41.723474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 228/457] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:41.760488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb032ab-a0e9-4ec0-b57f-bef21c703272 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:41.784495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:41.901833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb032ab-a0e9-4ec0-b57f-bef21c703272 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:41.945398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:41.946204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:41.946486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:41.946756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:41.952806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60cce-287d-46e6-a48d-72f1f41958a0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:41.953453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60cce-287d-46e6-a48d-72f1f41958a0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:41.954561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a60cce-287d-46e6-a48d-72f1f41958a0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:41.960168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:41.960168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:41.960621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 229/458] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:02:41.965999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6695ec-9693-49a5-bd56-615228184586 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:41.966571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6695ec-9693-49a5-bd56-615228184586 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:41.967224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6695ec-9693-49a5-bd56-615228184586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:41.980479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:41.981414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:41.982267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:41.982267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:41.982267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:41.982267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:41.984617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 230/459] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:41.996901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4d6695ec-9693-49a5-bd56-615228184586 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:41.998414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d6695ec-9693-49a5-bd56-615228184586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:42.008142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.107771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 230/460] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:42.109515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f5fa-ba0a-4826-a211-ca254aed3c8a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.110030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f5fa-ba0a-4826-a211-ca254aed3c8a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.111057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889f5fa-ba0a-4826-a211-ca254aed3c8a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.112556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 231/461] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:42.118128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d139-032e-4596-9096-84a5f735975a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.118718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d139-032e-4596-9096-84a5f735975a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.119227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2d139-032e-4596-9096-84a5f735975a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.121470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.143814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-05f2d139-032e-4596-9096-84a5f735975a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:42.145372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05f2d139-032e-4596-9096-84a5f735975a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:42.167872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2747877b-6b4d-46e8-b0a8-4823179346ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.199713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.211610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.212360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.212649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.212931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.213838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:42.214148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.216229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.228339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 232/462] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:42.229676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d139-032e-4596-9096-84a5f735975a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.239076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 231/463] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:42.246013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.355691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2d139-032e-4596-9096-84a5f735975a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.381069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4196a48-3acf-465b-884a-f24fcd3896e1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.400443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.401449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.402315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.402750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.410999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.416362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.417690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.418247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.418583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.418956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.419334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.420157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.421832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:42.440296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:42.441499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:42.442388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:42.442388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:42.442388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:42.442388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:42.444197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 233/464] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:42.445355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.482582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.514816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 232/465] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:42 2022] POST /identity/v3/users => generated 246 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:42.514816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.600217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547495c3-7343-4db7-94cc-6a033a661848 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.641952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.642803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.643058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.643338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.658755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.660363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.684698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e7658-3a91-4543-b3af-02b2d4b4ba3e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0b5f7929-0c8b-41d9-81fa-efb7d1c97dd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:42.686239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:42.687065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:42.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:42.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:42.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:42.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:42.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 234/466] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:42.690944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0e0b-8512-47cd-a5a7-73bbd76088d3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.691235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0e0b-8512-47cd-a5a7-73bbd76088d3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.691521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d0e0b-8512-47cd-a5a7-73bbd76088d3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.693449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 235/467] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:42.695246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0e0b-8512-47cd-a5a7-73bbd76088d3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.737273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.737945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.738239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.738510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.739247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:42.739554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.741055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb453f-c818-484d-bc2a-eded47ef9b58 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.754622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 233/468] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:42.755871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.756192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.756472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.779454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:42.780898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:42.808610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.834160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d0e0b-8512-47cd-a5a7-73bbd76088d3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:42.836572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:42.871917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 234/469] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:42.873090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:42.881971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:42.882628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:42.882924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:42.883268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:42.884414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:42.884733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:42.886262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:42.914148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 236/470] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:42.917307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.031563 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfaea4d-6c16-44cd-af78-679703f168f6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.061416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b254c-fa01-4430-a37e-02e0e04a3e65 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.067777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.068497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.068782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.069069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.069777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.071243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862c384-3ad5-4c1e-8962-8a49acc74a63 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.096648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.097447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.101885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.101885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.108643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.110159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.116715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:43.127677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:43.134392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 237/471] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:43.135297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.185668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 235/472] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:42 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:43.187372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9c22-da87-4c40-bc16-72a3a984a02b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.187669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9c22-da87-4c40-bc16-72a3a984a02b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.187954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e9c22-da87-4c40-bc16-72a3a984a02b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.193888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 236/473] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:43.193888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e9c22-da87-4c40-bc16-72a3a984a02b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.239423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:43.254668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b8538-0067-4c4e-824f-094f942f7456 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.305892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.307268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.307763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.308522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.310001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.312337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.332263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e9c22-da87-4c40-bc16-72a3a984a02b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.369533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.370273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.370559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.370836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.371688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:43.371999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.373441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d8a87-e8b9-4a87-a6e0-f52c77a42ccc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.387958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 237/474] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:43.389546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.389840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.390115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.405478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 238/475] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:43 2022] POST /identity/v3/users => generated 248 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:43.406622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.408072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:43.408625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:43.478712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:43.504678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 238/476] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:43.529896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03574f-9d24-40ca-809c-d87210eefd2e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.530203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.558810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:43.568491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.569193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.569484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.569770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.572543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.572543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.655299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 239/477] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:43 2022] POST /identity/v3/users => generated 249 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:43.656060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fefeff9-9873-42ef-8688-ab7cf781fefb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.703743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.704542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.704829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.705155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.705944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:43.707388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:43.739909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:02:43.739909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 18:02:43.739909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [parameters: {'id': '90e2b709031c4f66a577c648fd982cbb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 18:02:43.739909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 12 18:02:43.759482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:02:43.760450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:02:43.761364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:02:43.762223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:02:43.763124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:02:43.763940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': '90e2b709031c4f66a577c648fd982cbb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:43.764745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 18:02:43.765529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:43.769685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 239/478] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Jul 12 18:02:43 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:43.775562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:43.893665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db2693-93b3-469f-b012-59c6013010bf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:43.904544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:43.931541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:43.932398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:43.932695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:43.933015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:43.945657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-1e658d0a-a416-43e5-9e3b-3c091147a0b8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:43.954029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:43.954917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:43.955905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 240/479] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:02:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:43.962491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:44.068631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:44.091972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f7d403-e80a-4183-8694-4c12ea7b1227 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:44.118330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:44.119323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:44.119783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:44.120249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:44.121166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:44.121708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:44.123284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c80b8b-01df-4fca-afdb-f1a6c3c09e97 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:44.132536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 240/480] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:45.013685 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11c995-f47d-4bfd-b73c-571c5e6bbb21 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.014186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11c995-f47d-4bfd-b73c-571c5e6bbb21 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.014291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11c995-f47d-4bfd-b73c-571c5e6bbb21 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.016011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 241/481] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:45.030071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.030532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.030606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.053943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:45.055139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:45.146835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 241/482] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:45.181066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11c995-f47d-4bfd-b73c-571c5e6bbb21 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:45.317759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11c995-f47d-4bfd-b73c-571c5e6bbb21 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:45.358656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:45.359809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.360336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.360841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.380940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-96adce5d-151d-4613-a9d3-60d4b9ea6af1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:45.388821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:45.389745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:45.390532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:45.393684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 242/483] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:45.401320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:45.532495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:45.557600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e50822-29d3-4f11-b97a-4855cc8c07c9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.558235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e50822-29d3-4f11-b97a-4855cc8c07c9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.558772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e50822-29d3-4f11-b97a-4855cc8c07c9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.564143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c6271-ee67-4ba9-9ac3-93b74c08e5a4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:45.564996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 243/484] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:45.572656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.573204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.573676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.603464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:45.604512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.606194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.606842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.610849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:45.611844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:45.613353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:45.613820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:45.617461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:45.634417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 242/485] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:45.639364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:45.669381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:45.755750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3069750-acf4-4671-9bf0-51fef2b4dc9f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:45.793750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 244/486] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:45.800819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:45.801628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.801913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:45.802189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:45.811638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:45.815257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:45.819694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:45.820907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:45.853792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:45.854689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:45.855541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:45.855541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:45.855541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:45.855541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:45.855541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 243/487] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:45.866485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:45.950184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59ef754-f698-4836-8e8e-db04bcce9bd7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:45.998196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:45.999350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:45.999853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.000357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.024722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ad274-07ec-4773-8dd6-e928e45dee37 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.036763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-49f9c941-28e3-4fc6-8e26-529b99930b92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:46.045543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:46.046423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:46.047217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 245/488] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:46.052044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d6ab-7207-4d73-b538-5f4a9c92a94d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.052044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d6ab-7207-4d73-b538-5f4a9c92a94d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.052044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f035d6ab-7207-4d73-b538-5f4a9c92a94d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.055427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 246/489] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:46.056273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d6ab-7207-4d73-b538-5f4a9c92a94d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.071124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.071985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.072169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.072356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.073101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:46.073521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.075016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45245e98-a050-4ed2-b0a3-009faa546e1a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.080975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.088769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 244/490] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:46.090029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.090321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.090792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.108943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:46.110669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:46.162372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.174490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f035d6ab-7207-4d73-b538-5f4a9c92a94d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.183384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 245/491] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:46.184599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.211179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.212093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.212414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.212777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.213442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:46.213749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.215136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51013ed8-88d2-4659-8744-cb1f54b17b41 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.223904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 247/492] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:46.227693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a1d5-2bc9-47cf-84ad-e9e2885ca356 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.227693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a1d5-2bc9-47cf-84ad-e9e2885ca356 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.227693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a1d5-2bc9-47cf-84ad-e9e2885ca356 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.227693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 248/493] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:46.227994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6a1d5-2bc9-47cf-84ad-e9e2885ca356 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.293049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71220c4e-7375-482a-8ffe-5804967b58bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.320258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.334686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.335484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.335770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.336051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.339362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6a1d5-2bc9-47cf-84ad-e9e2885ca356 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.343283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.345393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-dcc19d9e-077d-4ff2-a711-0b69c5140f90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:46.361477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:46.362384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:46.363377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 246/494] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:46.363940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.364550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.364550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.379092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.379882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.380196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.380470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.381347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:46.382529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:46.391469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:46.399128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:46.400004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:46.400865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 249/495] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:46.401534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.421969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.458344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 247/496] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:46.459194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.519580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdad972-2cd9-45f0-9e8c-1080c40975c8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.556763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.557562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.557845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.558244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.569262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.570986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.572658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.573724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a41b553-304c-4c71-8641-5019924f5dab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:46.588992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:46.589919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:46.590778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:46.590778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:46.590778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:46.590778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:46.592350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 250/497] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:46.593364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.614471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.615148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.615428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.615700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.616571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:46.616877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.618773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.656839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 248/498] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:46.657733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.690645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.718659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc051141-8f68-4e82-a75c-52a5650a45ef None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.754487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.755322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.755738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.756019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.756802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:46.757116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.758720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.763862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4a3385-8267-4f56-8564-4695ffe7fae3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.767634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 251/499] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:46.768706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.799439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.800264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.800574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.800820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.817642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:46.825340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:46.826225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:46.827007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 249/500] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:46.828182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.840341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.890355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1499f7b3-1b8b-4e40-ba31-3aef2749bf0c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.924853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:46.926121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.926941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.927233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.927518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:46.928280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:46.928600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:46.930001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:46.934595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d88098-57b8-4a29-b0a5-ec1154d0fd30 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:46.947680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 252/501] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:46.947680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:46.980474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:46.981164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:46.981460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:46.981752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.053836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5a67-d6e7-42bb-ab25-cffeb29de07f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.054890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.056396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.070245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.088185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.088980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.089266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.089546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.099847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.101320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:47.118402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:47.119335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:47.120209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:47.120209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:47.120209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.120209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:47.120209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 253/502] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:47.120485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.145938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.156368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 250/503] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:47.160472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.219087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69cafa7-1a9b-4200-84c1-5660da934dfe None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.252226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.252947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.253305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.253586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.254339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:47.254651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.256043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06f9c1-a4d1-4692-9607-3a97cc32c978 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.256690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5306941-d4b4-4590-afed-6cbcf551e430 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.263822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 254/504] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:47.265151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec2bc-b90a-48d1-9934-a142cf345851 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.265450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec2bc-b90a-48d1-9934-a142cf345851 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.265734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ec2bc-b90a-48d1-9934-a142cf345851 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.267612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 255/505] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:47.268384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec2bc-b90a-48d1-9934-a142cf345851 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.301237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.302183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.303013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.303405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.303761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.314881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.314881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:47.327436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:47.328363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:47.329262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 251/506] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:47.329964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.377440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ec2bc-b90a-48d1-9934-a142cf345851 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.377617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.410281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.410939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.411223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.411498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.412250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:47.412562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.413944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.425198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822a654-edb1-4cbc-bc69-562e86d83f36 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.426800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 256/507] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:47.431293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.464055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.464874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.465153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.465424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.475301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.476771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-aaac4815-a509-47ba-ae22-44d8a0b78537 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:47.494293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:47.495269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:47.496331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:47.496331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:47.496331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.496331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:47.496666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 252/508] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:47.497931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.498408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.498756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.513776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.515088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:47.516319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:47.522931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b8ef7-265e-449a-852e-ffb1ea949cb6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.556659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.557448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.557734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.558011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.570898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.572212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.584562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 253/509] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:47.585452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:47.589463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:47.590438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 257/510] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:47.591462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.622263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.693273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5cdb6-7cad-44dc-b04e-f7a3054f44f0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.693831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f535e-5677-44b6-ab56-96e10c588b3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.726888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.727077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.727556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.727823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.727913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.728103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.728218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.728406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.728973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:47.729282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.730740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.736146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.737583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.747766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 254/511] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:47.748694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:47.753442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:47.754486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 258/512] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:47.755405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.758096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.838015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.847796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7d21e-87cf-489b-ba32-e1cbd47fb355 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.862110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24891a-30a2-467e-9800-9d22d7d3a736 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:47.881774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.882433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.882715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.882988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.883707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:47.884013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.885426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.894809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:47.895466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:47.895750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:47.896027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:47.896557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 255/513] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:47.897434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.900400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:47.901576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:47.903003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:47.915474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 259/514] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:47.916624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:47.978541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:47.999555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4739cf-7267-4e4d-abed-5647f75778c8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.015638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f0a6-0742-405d-835f-d8e6e29cac3c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.032702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.033480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.033762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.034042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.044309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.045765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.048824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.049466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.049748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.050023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:48.062670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:48.063622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:48.064519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:48.064519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:48.064519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:48.064519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:48.064519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 256/515] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:48.064797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.067152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.120901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.122288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.162093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fd8f92-a615-4bec-b615-c3faeee38dd2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.180638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.194180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.195035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.198169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.198169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.198169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:48.198169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.198169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.215244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 257/516] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:48.216044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.219196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 260/517] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:48.220605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.280254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.317106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ae026-2295-4d98-b5b5-830d2a0e4914 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.320767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd82ab-33ed-46e3-aadc-f96ad216c202 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.351044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.351847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.352308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.352591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.354492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.355279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.355560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.355833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.359498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.361022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.362899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.364400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:48.375497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:48.376567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 261/518] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:48.377472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:48.378747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:48.379539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 258/519] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:48.385146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.402587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.477326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225c8e6-e1d3-4e56-8c3d-efa95be41c3e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.479591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f950f-ce05-4d55-9a47-5b3db56f1825 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.498588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.510240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.510891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.511170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.511446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.512207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:48.512505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.512629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.513142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.513431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.513775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.513938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.525401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 262/520] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:48.526183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.580705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.582305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.608171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.626484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee3d7d9-8c93-448e-9078-8fdc93c97e2c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.659733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.660602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.660883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.661154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.671830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.673332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.678426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 259/521] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:48.679269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:48.690845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:48.691705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:48.692666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:48.692666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:48.692666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:48.692666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:48.692666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 263/522] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:48.692923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.703634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.780576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6af16-d8f7-42d9-9030-b97c724fabaf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.790421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193a92f-6b35-492e-a280-424d384904ec None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.818028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.818234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.818518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.818794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.819632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:48.819943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.821430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.827370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.828036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.828354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.828661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.829463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:48.829777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.831220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.832934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.838228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 260/523] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:48.839022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.849363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 264/524] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:48.850188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:48.922055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:48.943278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6173f-2425-4d74-9497-5eab49da7404 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.948562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b48375-17f1-4c99-8009-0f8cfcf74b5d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:48.976494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.977166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.977456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.977740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.978432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.979865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:48.980924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:48.981712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:48.981998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:48.982279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:48.992646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:48.994083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:49.011670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:49.012803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 265/525] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:49.013733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.058198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.087559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 261/526] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:02:48 2022] POST /identity/v3/users => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:02:49.088426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.113446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974cdcd-0e32-4226-aed5-440f01f951aa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.154289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.154966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.155243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.155523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.156302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:49.156610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.158027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.170515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 266/527] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:49.171527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.221146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039d1c3-bc4d-411d-881e-fbf97468b45d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.261455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.262252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.262427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.262709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.265503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.286715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486c2b1-9d04-48f8-84b0-48f2b6e3a788 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.295993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.328138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.328834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.329124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.329407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.330258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:49.330577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.332030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.336160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.337611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.337862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 267/528] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:49.338667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.458206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca17efc-8592-4bdd-aa18-77877e20646c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.461308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 262/529] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:49.462191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.496715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.498169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.498462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.498747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.499492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:49.499799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.501287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.506872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.515704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 268/530] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:49.516654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.561820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.579559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20234f3-47e1-463d-aac7-39229da60124 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.618157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.619048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.619403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.619744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.627857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.629435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:49.643916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:49.645064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:49.646128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:49.652084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 263/531] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:49.653056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.653296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03838cf-54e9-4d81-a939-2f7b3262b337 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.697148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.698113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.698500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.698881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.713607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.715735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:49.738755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:49.739636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:49.740515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:49.740515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:49.740515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:49.740515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:49.746910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 269/532] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:49.747936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.769806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.779234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf529ab-0f8d-4148-a525-79c0e64903b4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.837979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.838714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.838997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.839334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.849135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.851348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.852767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:49.870968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183b1d-a395-4446-b316-6e3b2221d216 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:49.872340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:49.873153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:49.873999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:49.877765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 264/533] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:49.878505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:49.912312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:49.912986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:49.913286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:49.913613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:49.914415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:49.914732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:49.916454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:49.933317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 270/534] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:49.933317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.021001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63929667-3363-40f2-bfb4-9637f8e65148 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.041679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d3f98-ba50-4114-83ca-57aec0fdd2e9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.064325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.065026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.065309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.065587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.066566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.066672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.068013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.080848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 265/535] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:50.081818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.085000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.086804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.087292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.087785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.088814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.089321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.091507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.098634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:50.108327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 271/536] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:50.109296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.112138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:50.203257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b13df-1422-497d-995f-f2389a1caf54 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.224298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6ef450-de83-46a7-8426-08b7606c41d4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.245175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.245838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.246133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.246416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.247265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=c342400998514fe5beb96566fba15918) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.247584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.249598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.264161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 266/537] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:50 2022] GET /identity/v3/role_assignments?user.id=c342400998514fe5beb96566fba15918&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:50.264161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.285700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.286863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.287358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.287825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.305408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.307234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:50.344185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:50.345104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:50.345929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:50.348552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 272/538] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:50.353842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.356728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:50.384799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023782e1-e75f-4215-aefc-f317ab602283 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.426348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.427031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.427320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.427601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.429009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=8bc8f7da375441049d3975f1b80951a9) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.429336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.431080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.438662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 267/539] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:50 2022] GET /identity/v3/role_assignments?user.id=8bc8f7da375441049d3975f1b80951a9&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:50.501448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:50.561716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f7ff7-c78c-414f-9161-3642e27bb9bf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.600606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.601528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.601981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.602410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.603406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.603881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.605539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f03696-98a8-44fb-9f3e-db9a3ca400c3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.621567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 273/540] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:50.627566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:50.735394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3a9b3-9ab4-4577-8599-8f4a664a8220 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:50.769657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:50.770322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:50.770608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:50.770890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:50.771736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=f30afe81d08546e5b56ab490893ef303) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:50.772055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:50.773524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28738d-1952-4a97-b064-0e17f41b6a73 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:50.779691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 268/541] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:50 2022] GET /identity/v3/role_assignments?user.id=f30afe81d08546e5b56ab490893ef303&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:51.247144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fb7c-71da-4993-81aa-45fc342e16d6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.247629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fb7c-71da-4993-81aa-45fc342e16d6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.247629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36fb7c-71da-4993-81aa-45fc342e16d6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.249246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 274/542] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:51.254575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6e51-12ec-414a-952f-34ba142e7988 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.254997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6e51-12ec-414a-952f-34ba142e7988 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.255134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba6e51-12ec-414a-952f-34ba142e7988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.271937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:51.281104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52ba6e51-12ec-414a-952f-34ba142e7988 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:51.282893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52ba6e51-12ec-414a-952f-34ba142e7988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:51.373824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 269/543] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:51.408050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36fb7c-71da-4993-81aa-45fc342e16d6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:51.557736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36fb7c-71da-4993-81aa-45fc342e16d6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:51.580972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:51.591056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73860-d560-4f3b-b50d-49076a8bead7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.591346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73860-d560-4f3b-b50d-49076a8bead7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.591629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73860-d560-4f3b-b50d-49076a8bead7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.593249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 270/544] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:51.597697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:51.598492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.598775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.599047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.599207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.599492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.599775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.615166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:51.617541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:51.618724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:51.623196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:51.624078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:51.624887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 275/545] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:51.632185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:51.696494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 271/546] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:02:51.722360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:51.789578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329bec4-9415-491d-8eee-8ef2e74c27cf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:51.832137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:51.832137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:51.832137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:51.832137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:51.832467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:51.832467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:51.832467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:51.841108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:51.854291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 276/547] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:51.860320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:51.907334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbde14-1da7-41d4-a743-6d1502c7dcc6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:51.937507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:51.999005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18409-439d-4772-b69a-2cef6245402b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.012791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.013661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.013954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.014225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.036276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.037712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.038216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.038684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.042546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:52.050384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:52.050506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:52.051414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:52.052225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:52.055290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.056252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 272/548] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:52.066003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:52.089947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:52.090990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:52.091837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:52.091837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:52.091837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:52.091837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:52.101751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 277/549] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:52.124711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.206437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fe6ee-58ce-4671-a1d0-64f9b7fe033f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.232803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:52.241995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.242945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.243428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.243899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.245082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:52.245600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.247240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.257767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 273/550] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:52.264107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.299714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:52.306078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3608b75a-c0d3-4466-9f36-3392c78ab7ea None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.344766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.345354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.345643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.345922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.346809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:52.347127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.348915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.363162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 278/551] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:52.370357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.450864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be0222-039f-42c4-93aa-3d7e660c9c1d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.491321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dc73a-07f0-4185-bc93-95de6867f31c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.532165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.533022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.533330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.533738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.541919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.543474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.548796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.549849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.550347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.550779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:52.559811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:52.560787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:02:52.561724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:52.565593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 279/552] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:52.572873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.574785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.576280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.610852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:52.611591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:52.612542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:52.613422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:52.613422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:52.613422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:52.613422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:52.617785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 274/553] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:52.624580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.692665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:52.733738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e47d4-ef3e-4652-a9bc-6979aabeee0e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.764082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effcac9-ee6d-4b1d-90d6-0fd552b9879c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:52.782408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.783098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.783383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.783659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.784544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:52.784959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.786415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.807409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:52.808094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:52.808414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:52.808685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:52.809423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:52.809735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:52.811135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:52.840916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 280/554] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:52.846560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.852467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 275/555] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:52.858814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:52.960913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:52.995405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91f91-45f4-44c6-a5d5-a7b48750f78d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.005126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.008787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5099a5-8794-43df-b459-a45a7fdf95d9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.042850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.043960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.044468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.044941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.046054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.046826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.047135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.047935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.056886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.058351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c562eda5-d97c-4723-b917-ccef87ef36ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:53.073580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:53.075017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 276/556] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:53.075970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5b18-0229-4aa9-b7ea-780cb8316c81 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.077267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5b18-0229-4aa9-b7ea-780cb8316c81 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.077267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27f5b18-0229-4aa9-b7ea-780cb8316c81 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.077961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 277/557] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:53.078898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef2ac-72bb-4cde-92f7-490878523d5d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.079527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef2ac-72bb-4cde-92f7-490878523d5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.079730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaef2ac-72bb-4cde-92f7-490878523d5d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.084168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 278/558] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:53.084168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaef2ac-72bb-4cde-92f7-490878523d5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.127335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.128847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c19e5-40a6-4e5e-86e4-edebc1052f95 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.190388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaef2ac-72bb-4cde-92f7-490878523d5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.201812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.225848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.226492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.226778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.227053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.227699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 281/559] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:53.229514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:53.229514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.229702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.229702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.229702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.231144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fad9fef-d536-41a4-873f-24d3081d79a2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.248086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:53.249320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:53.250483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 279/560] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:53.251540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.251833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.252132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.269084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:53.270265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:53.286791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.327373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 282/561] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:53.329493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.352285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 280/562] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:53.353535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.434942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8392a3b-f2a6-4f14-9e25-c98813921292 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.437586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.459631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eb0b-968e-49ea-8d29-f3d523f842a8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.468712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.470071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.470357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.470635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.480537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.481939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.493211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.493997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.494281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.494556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:53.499718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:53.500672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:53.501640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:53.501640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:53.501640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:53.501640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:53.501640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 283/563] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:53.501935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.507348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.508856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.518592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:53.527929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:53.532319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 281/564] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:53.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.601236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b5991d-085f-49ae-8ef4-c0232b2f8b7b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.627922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bac9a-0a3e-4f66-a3b5-9c1f537d41da None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.633556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.634346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.634646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.634929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.645433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6f93ead8-f197-4e85-b220-f1b466154797 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:53.653812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:53.654956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:53.655795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 284/565] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:53.656541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf3fb-827a-4b6d-90b9-c9d20576c740 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.656625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf3fb-827a-4b6d-90b9-c9d20576c740 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.657399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cf3fb-827a-4b6d-90b9-c9d20576c740 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.658600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 285/566] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:53.660886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf3fb-827a-4b6d-90b9-c9d20576c740 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.666827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.667624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.667911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.668217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.678697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.679427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:53.687235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:53.691372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 282/567] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:53.692230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.747569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.764182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cf3fb-827a-4b6d-90b9-c9d20576c740 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.787848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721f708-36a2-4450-94fb-bf173c879b01 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.797475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.798136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.798416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.798690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.799404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:53.799707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.801119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.813517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 286/568] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:53.814633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.823053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.823721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.823999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.824301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.825023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:53.825329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.826698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cef49-76e0-4820-90c7-edc62b9ba608 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.838806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 283/569] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:53.840004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.840391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.840674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.856398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:53.858632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:53.895772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:53.919238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88901c5c-07d8-4083-9691-5f68d934a8ba None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:53.923523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 284/570] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:53.924386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.957561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:53.958231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:53.958523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:53.958798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:53.959551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:53.959861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:53.961283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:53.971883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 287/571] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:53.971883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:53.975289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.024814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab52f1-282f-4d57-a0fb-3fe229367a63 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.057972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.058628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.058910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.059190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.059933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.060265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.061634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.069699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 285/572] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.070468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.071973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50071402-39a2-4c2e-a65e-5aa4eb8423df None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.104949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.105743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.106028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.106307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.113482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.114929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.116660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:54.129989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:54.130920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 288/573] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:54.132555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.170945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb0aab-5bec-417c-8528-415d572e88b8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.185424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.206458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.207282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.207569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.207845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.215342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.216837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.227457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f35066-3c4c-4c7d-9137-d24ff5fb8ccf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:54.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:54.232320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:54.233224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:54.236253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 286/574] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:54.237201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.263244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.264068 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.264392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.264674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.275705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:54.283443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:54.284459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:54.285301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 289/575] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:54.285981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.340590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081dd3-3f58-4f4e-9b1d-db715b776003 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.343363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.374337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.375128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.375964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.376274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.384155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7731317d-a995-4ea1-a6fc-41ee106ec834 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.386329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.387785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:54.405053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:54.406034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 287/576] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:54.407035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.421743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.423378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.423664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.423936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.431568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.434284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.435773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:54.453282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:54.454273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:54.455185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:54.455185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:54.455185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:54.455185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:54.455185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 290/577] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:54.455475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.506232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe853f0-98e7-4fdf-aada-0c92b7d36c7f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.540063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.540941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.541258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.541533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.542313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.542621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.544051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.555475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3239dc02-bec3-45cc-89bc-cba615559a02 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.561397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 288/578] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.562193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.566678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.591301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.592039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.592353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.592631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.593420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.593725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.595775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.608345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 291/579] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.609297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.651372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.667711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612a167-338b-4247-8b92-5c41f939f8eb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.701287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.701947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.702226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.702501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.703242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.703574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.704970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.707973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2908d4-00b0-455d-b647-1b70501158da None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.712659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 289/580] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.713433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.745559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.746226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.746519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.746807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.747542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.747851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.749276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.760324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 292/581] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.761204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.792533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.813367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2580e33-aa94-423f-8708-8b0e12404100 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.847101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.847761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.848043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.848356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.849079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.849391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.850776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.860329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c2f72-0dd0-41e9-ae7b-58fa178881e9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:54.866998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 290/582] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.866998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.870867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:54.898478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:54.899137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:54.899430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:54.899713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:54.900597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=57d606342e46439f8f1274278438fb1c) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:54.900916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:54.902371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:54.908679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 293/583] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/role_assignments?user.id=57d606342e46439f8f1274278438fb1c&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:54.909546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:54.970056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0a9f3-4311-4de7-bb3f-aaf6f1011556 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.007798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.008894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.009266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.009638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.017953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.025211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b7989-5e4f-4470-adaf-755bc497fa35 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.026967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=50043e6bb2414d7dbf9feecd1b1980bd, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.028742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.060764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.061560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.061846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.062128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.072821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.074324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:55.091874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.093002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 294/584] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.094758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.100742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 291/585] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:54 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:55.101591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.186233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.216834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d116ac-5a3b-4235-9f22-e9f450147071 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.246929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54d28d-f27d-4b13-9758-63f66816ca6c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.256318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.257188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.257477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.257778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.267562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.269043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:55.285656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.286665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:55.287951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 295/586] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.288714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.295067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.296094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.296553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.296994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.298861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.307967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.309668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:55.327701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.329345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:02:55.330301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:55.332281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 292/587] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.334807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.410693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6747eab-70e8-4322-80a0-d1a71d72c825 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.449631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ab3e0-60f6-4fc5-8dbe-01168ae31b4c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.459443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.460143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.460432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.460714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.461917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:55.462237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.464033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.470501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.484196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 296/588] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:55.485385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.500937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.501936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.502436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.502962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.503993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:55.504514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.506156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.525610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 293/589] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:55.526750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.575732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.614168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8061c463-a2c4-4ad0-8639-182b96ca55b9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.649461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10393139-eaaf-4b80-b275-25ba9ec3bc7e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.649943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.650852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.651348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.651820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.653207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:55.653720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.655403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.674385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 297/590] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:55.675545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.694904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.695712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.695996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.696295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.705785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.707402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:55.723750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.724734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:02:55.725660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:55.727983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 294/591] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.728978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.779158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.785536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0ab5d-219a-4e51-9753-6d2f47c5d082 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.822316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:55.834166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.835257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.835761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.836277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.847985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.849770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.868688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540fbb99-f982-4703-83ca-9b4984d699a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:55.870135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.870983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.871859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:55.871859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:55.871859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.871859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:55.874074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 298/592] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.875791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.916404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:55.917728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:55.918026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:55.918302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:55.932944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:55.935231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:55.954253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:55.955426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:55.956347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:55.956347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:55.956347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:55.956347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:55.958149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 295/593] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:55.959293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:55.991015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ba257-103a-4227-a7cf-77cd1fa87a55 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.037149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.037835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.038122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.038403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.039255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.039566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.041554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.065700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.072835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 299/594] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.073912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.085463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837476c8-2eef-4d40-86bf-e2583122d849 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.120190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.123583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.124578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.125312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.125782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.126666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.127133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.128993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.142188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 296/595] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.143361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.205933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a8dbc-9abe-446e-a44b-553bb9d5ee40 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.244722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.245793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.246300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.246815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.247734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.248265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.249822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.260128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa525fb-3775-4232-a319-19eb2ed5d8d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.266288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 300/596] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.267175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.306458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.307267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.307564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.307825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.320203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.321711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.329199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:56.340284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:56.346595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 297/597] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:56.347685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.381329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.388251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a71d4a-45f9-4218-8e2f-7d7c9a5b2d25 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.426712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.427513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.427799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.428073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.435544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.437140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:56.451856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:56.453073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:56.454768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 301/598] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:56.455291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.456575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593d755-7003-42f8-9e8a-15ca01e41e5d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.492459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.493506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.493941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.494363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.501694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.503473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:56.518688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:56.519794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.520918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:56.522643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 298/599] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:56.523629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.564721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1fe5a-4584-4392-827d-5700e887252c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.602376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.604318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.605227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.605665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.606144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.607009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.607476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.609025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.626623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 302/600] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.627829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.646779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.652768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd214b78-54c5-403c-8561-6e4774133428 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.699091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.699777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.700273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.701746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.702734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.704499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.706802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.719936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 299/601] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.721067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.753971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3816069-1f2f-4a60-b31b-c300c162b3f7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.799297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.800101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.800904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.801187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.802119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:56.802559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.804163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.824180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 303/602] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:56.826232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.852905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0644d-f995-45c1-b527-e13c6361551c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.875803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.894344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.895222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.895512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.895789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:56.903046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:56.904457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:56.920693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:56.921633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:56.922545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:56.923577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:56.926673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 300/603] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:56.927550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:56.956659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254672e8-7678-4cae-836a-4d9c0bed2eae None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:56.995538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:56.996718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:56.997085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:56.997370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/c342400998514fe5beb96566fba15918/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.018527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=c342400998514fe5beb96566fba15918, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:57.020023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:57.032770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b1b880-edab-4d1a-b87d-fcbecc1bd9ab None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.067513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.068424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.068710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.068985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/8bc8f7da375441049d3975f1b80951a9/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.083164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=8bc8f7da375441049d3975f1b80951a9, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:57.084644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29468a93-3951-4da9-a5c6-a97cb6e4c5be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:57.087664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 304/604] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:56 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/c342400998514fe5beb96566fba15918/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:57.088704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.188275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 301/605] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:56 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/8bc8f7da375441049d3975f1b80951a9/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:02:57.188275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07336b3-0cf5-4034-a1d8-82948898246e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.188275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07336b3-0cf5-4034-a1d8-82948898246e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.188275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07336b3-0cf5-4034-a1d8-82948898246e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.188275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 302/606] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:57.199666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789066-a99d-436c-8e4e-b8ae2a2c6bbd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.199988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789066-a99d-436c-8e4e-b8ae2a2c6bbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.200318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4789066-a99d-436c-8e4e-b8ae2a2c6bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.234093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c4789066-a99d-436c-8e4e-b8ae2a2c6bbd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:57.238509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4789066-a99d-436c-8e4e-b8ae2a2c6bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:57.246436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaf31db-b45f-470c-ad3c-9e5c0e565bba None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.272544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:57.278623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:57.290882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.291557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.291840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.292260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.292958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:57.293264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:57.294731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ab92-7fce-4722-92f5-9eab2869029b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:57.310948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 305/607] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:57.319172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfd28-14f0-40f2-a1e0-7eb0975d8e6a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.319172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfd28-14f0-40f2-a1e0-7eb0975d8e6a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.319172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892bfd28-14f0-40f2-a1e0-7eb0975d8e6a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.319172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 306/608] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:57.319172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bfd28-14f0-40f2-a1e0-7eb0975d8e6a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.334771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 303/609] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:57.336087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.336422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.336702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.366398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:57.367362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:57.450423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 304/610] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:57.451762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.456767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892bfd28-14f0-40f2-a1e0-7eb0975d8e6a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.501613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.503038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.503425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.503827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/f30afe81d08546e5b56ab490893ef303/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.524359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=f30afe81d08546e5b56ab490893ef303, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:57.526525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:57.556452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:57.568255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c3ba8-8042-479a-887c-6526adeabeda None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.604160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 307/611] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:57 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/f30afe81d08546e5b56ab490893ef303/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:02:57.605097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.615338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.616193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.616779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.617061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.641527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:57.649948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:57.650924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:57.652270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 305/612] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:57.660147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.679635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:57.809872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd3a1f-c503-4f69-bb86-61f2b1797a45 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.847685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da59c4-8a4f-4a00-aa91-68c5af75fc14 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:57.850949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.852012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.852528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.853210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.866021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:02:57.875100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:57.876036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:02:57.878042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:57.881238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 308/613] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:57.888143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:57.888143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:57.888143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:57.888143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:57.888498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:57.888498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:57.888498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:57.890077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.899318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 306/614] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:57.905436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:57.928527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.047049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.055120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72efb68-77e1-4300-9e68-8b5e7dd62522 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.058162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e1f1c-4a01-419c-92a7-465fda1625a1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.090547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.091325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.091618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.091905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.109547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.111016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.124717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.125427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.125767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.126054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.126816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:58.127130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.130180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:58.145840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:58.146912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:58.147914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:58.147914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:58.147914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:58.147914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:58.149324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 309/615] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:58.149573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 307/616] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:58.154926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.159064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.276508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.335586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002e065-269d-43c4-8a4d-afbd610bf893 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.339478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1416214-6e1e-4578-b20f-84de2545d2fb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.370526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.371119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.371411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.371695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.372467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:58.372586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.372781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.373281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.373570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.373843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.374181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.385246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.386699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.387201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 308/617] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:58.397164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:58.404635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:58.405583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:58.407122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:58.407122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:58.407122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:58.407122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:58.407122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 310/618] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:58.413101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.476652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.538307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91654a-05f4-4ba9-8243-208a034bc991 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.582475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e88aa4-5007-4b21-9842-5390170674c5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.605385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.606066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.606356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.606640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.607142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.607372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:58.607882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.609096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.619868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.621968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.621968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.621968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.629646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.631244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.634693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 311/619] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:58.641381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:58.651160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:58.653606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:02:58.656650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:58.658077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 309/620] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:58.660151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.743711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.763864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e1da9-fcd1-4625-8ef2-a1802d159af5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.788718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee1c9e4-3c09-49cf-8c4d-4615639e7f19 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:58.815911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.820765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.820765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.820765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.820765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:58.820765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.821588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.840346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 310/621] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:58.845837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:58.858410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:58.859215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:58.860025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:58.860332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:58.871294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:58.880924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:58.908491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:02:58.909155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:58.911286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:02:58.913591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 312/622] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:58.916522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.018330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58e4aa-e1f9-48c8-914f-47792b27ed2f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.072477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a1ade-dab7-4373-bf6a-e6fffa9266c6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.096353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.097154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.097435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.097709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.118138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.119630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.130349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:59.151122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:59.152055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:59.152999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:59.152999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:59.152999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:59.152999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:59.152999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 311/623] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:59.153291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.153824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.153922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.160154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.160154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:59.160154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.160154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.164789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.190558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 313/624] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:02:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:02:59.192990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.295277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.305434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69917a65-963e-45a9-b668-d2f49400911e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.342655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.343451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.343767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.344607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.345334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:59.345795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.347170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.359550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 312/625] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:59.365172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.462380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a83a8-6358-4d32-956e-54cab0bd13f2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.481906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dffa2b1-6b70-42ad-9e8b-3625c6557953 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.519249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.520059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.522642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.522938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.534121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.534783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.535098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.535382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.537169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.538728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e40bca4e-1f69-486b-8ec0-97857446a9c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:02:59.560688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:59.561644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:02:59.562565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:59.565490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 313/626] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:02:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:02:59.567013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bd1c-4b8d-4ad0-a889-9ce559ab8a7d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.567451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bd1c-4b8d-4ad0-a889-9ce559ab8a7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.567865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bd1c-4b8d-4ad0-a889-9ce559ab8a7d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.573286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 314/627] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:59.573286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bd1c-4b8d-4ad0-a889-9ce559ab8a7d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.594840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.606339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.620620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.622259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836207aa-0634-4ef5-a32f-dd55922b0fcc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.698966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bd1c-4b8d-4ad0-a889-9ce559ab8a7d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.732834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 314/628] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:02:59.734430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.734931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.735437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.739569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.740261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.740575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.740819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.741986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:02:59.741986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.743366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a3ad9-55ad-4dc1-b8f1-9fae16db3821 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.752737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:59.754060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:02:59.756411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 315/629] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:02:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:02:59.757916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5cea5-2332-4f60-ad50-1500bb8e255c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.758213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5cea5-2332-4f60-ad50-1500bb8e255c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.758493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5cea5-2332-4f60-ad50-1500bb8e255c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.759860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 316/630] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:02:59.761054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5cea5-2332-4f60-ad50-1500bb8e255c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.835998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 315/631] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:02:59.837850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:02:59.841620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.866077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:02:59.874351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5cea5-2332-4f60-ad50-1500bb8e255c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.911594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:02:59.912420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.912708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.912984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.924487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:02:59.925395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e485f5a7-9a3c-44fc-a25d-4466f42912be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:02:59.943602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:02:59.944696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 317/632] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:02:59.950289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:02:59.963239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bf47a-dada-4cdc-be0e-9774304a066c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:02:59.965705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:02:59.966903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:00.011420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.012259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.012541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.012816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/57d606342e46439f8f1274278438fb1c/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.028027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=57d606342e46439f8f1274278438fb1c, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.029516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.034870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 318/633] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:00.035715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.081693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 316/634] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:02:59 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/57d606342e46439f8f1274278438fb1c/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:03:00.082532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.091278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.142245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53483373-8c4f-47d6-b6fd-9b8961b5b320 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.157246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.181111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.182189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.182562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.182848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.195571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:00.199468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2a5c5-0239-4192-9efa-4b9ce7ceab46 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7f364e42-18c6-4adc-bc62-bc6f9f851403 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:00.204299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:00.205302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:00.206139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 319/635] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:00.207344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca7e6-e8b7-4817-bbe7-72fe0792730b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.207527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca7e6-e8b7-4817-bbe7-72fe0792730b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.207811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ca7e6-e8b7-4817-bbe7-72fe0792730b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.209183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 320/636] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:00.209886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ca7e6-e8b7-4817-bbe7-72fe0792730b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.255018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.255730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.255991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.256351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.257092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:00.257399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.258771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.271079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 317/637] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:00.271682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.326438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ca7e6-e8b7-4817-bbe7-72fe0792730b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.341499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.365706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.366577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.366875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.367527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.377093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd4918-7f76-4bef-af10-fd39e86c7b46 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.380178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-047c6d1b-0052-4618-b82a-a8b17f1c9de6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:00.387909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:00.389022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:00.389863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 321/638] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:00.390602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.390677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.391341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.407169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:00.408398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:00.410335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.420567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.422387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.422387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.422662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.423959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:00.424305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.425966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.441383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 318/639] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:00.441383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.480500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 322/640] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:00.481432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.558974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed9e5b-892a-4de9-8e8c-09320152cf40 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.596127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.596333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9e687-5884-4b6f-8b0f-439bc48d3f25 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.596940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.597226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.597504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.598643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.606944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.608531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:00.623374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:00.624293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:00.625251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:00.629499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 319/641] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:00.630363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.634108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.634974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.635424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.635861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.636801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:00.637266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.638800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.649026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 323/642] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:00.649979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.686692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.740647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6f857-bbe0-47cd-a079-3e8620c293b3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.753808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8463f5-b3f1-431d-9f06-e5ec112f2ee1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.777072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.778163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.778458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.778739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.790253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.791756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.791971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.792905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.793339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.793829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.805453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:00.811243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:00.812252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 320/643] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:00.813237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:00.822718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:00.823683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:00.824629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:00.827905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 324/644] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:00.829514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.860609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.918517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:00.922544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e938f1c-cc96-4d69-82cb-efe9599ee2d6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.936977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d1474-2aa8-4594-9d80-75e0842b85e0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:00.956438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.957099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.957385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.957665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.958458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:00.958767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.960396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:00.977106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 321/645] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:00.977252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:00.977385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:00.977476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:00.977476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:00.977476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:00.988805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:00.990252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:01.007282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:01.008397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:01.009503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:01.009503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:01.009503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:01.009503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:01.013010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 325/646] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:01.013653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.091833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab20259-0242-4089-995a-1b31dc97b3b2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.101872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.123772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de099b12-4448-4aa5-bb58-d10b97496a6a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.127535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.128376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.128761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.129175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.130024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.130433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.131899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.144379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 322/647] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.149458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.161700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.162697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.163140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.163426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.164215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.164528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.166164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.171861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.175805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 326/648] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.176781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.260757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9ef5-77d5-4d67-ac0c-492785419a10 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.284262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9a916-552f-41c7-9d7d-2e5cec98d79d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.296533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.297435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.297729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.298006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.298849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.299165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.300695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.316144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 323/649] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.316144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.331110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.332034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.332410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.332870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.333691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.334072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.335634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.346055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.354779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 327/650] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.355970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.427873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.455267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f96192-b9e6-4739-adfa-00ea6bd8b53b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.473435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f20147-3268-46da-9036-2cf9716f762c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.501466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.502593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.502593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.502855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.510848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.512330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.519197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.519948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.520278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.520553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:01.527097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:01.528043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:03:01.529030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:01.533489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 324/651] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:01.533927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.535051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.536750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:01.565211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:01.566271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:01.567214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:01.567214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:01.567214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:01.567214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:01.568819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 328/652] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:01.569778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.638471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.663333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ccd40-571b-4540-9437-eb34e7a54182 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.691243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453889-8a3a-4bad-9bfb-87d7bc74b867 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.709591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.710660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.710952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.711634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.722801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.724999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.731965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.732804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.733190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.733569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.735059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.735473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.737047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:01.742745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:01.744102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 18:03:01.745872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:01.748236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 325/653] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:01.749493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.754793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.765890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 329/654] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.766739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.886119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f892e461-fbfc-4a60-a00a-10460ecb2c26 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.897992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cf2e7-ba61-4961-af35-06aba0bad140 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:01.902321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:01.935241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.935564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:01.936440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.936673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:01.936784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.937144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.937974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:01.938430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:01.938593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.939001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.939801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:01.940313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:01.940702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.942442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:01.954923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 326/655] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.955330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:01.965473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 330/656] 10.222.0.33 () {56 vars in 1137 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:01.970568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.039366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.084131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eaff16-5e20-4e68-86cc-b98baf6d9998 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.087624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1681b63f-2e13-4da6-9b5b-ab3a36d9e737 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.124923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.125758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.126044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.126327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.133938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.134107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.135337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.135510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.136406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.137261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:02.152324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:02.153307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:02.154253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 331/657] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:02.155427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.191346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.217551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.219616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaead3-db84-4aec-bacc-9e18a058cd30 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.271147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619801eb-7717-4cf5-be30-9ecdf39e8423 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.284629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.307791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.308467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.308753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.309035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.326321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 327/658] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:02.327854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2baf4-30f4-4136-b4fe-8ec7d6a3d111 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.328706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2baf4-30f4-4136-b4fe-8ec7d6a3d111 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.328989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2baf4-30f4-4136-b4fe-8ec7d6a3d111 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.330426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 328/659] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:02.330964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2baf4-30f4-4136-b4fe-8ec7d6a3d111 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.381525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.383041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.412057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.436089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2baf4-30f4-4136-b4fe-8ec7d6a3d111 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.484146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.484983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.485204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.485482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.486336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:02.486657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.487447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 332/660] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:02.491919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.492032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c494b0d-eb62-4d24-bfcd-de7b882c80a9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.510996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 329/661] 10.222.0.33 () {56 vars in 1139 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:02.512518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.512809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.513089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.532480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:02.533877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:02.551146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.602340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a0f49-2d9c-400f-8285-e83a73d10e2d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.604184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 330/662] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:02.604750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.639768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.647843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.648742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.649035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.649312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.659967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.661571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:02.680205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:02.681145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:02.682046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:02.682046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:02.682046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:02.682046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:02.682046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 333/663] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:02.682903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.725629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720658d2-b500-461e-940c-13c68f619bd3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.758414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.759204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.759481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.759761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.770237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.771699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.787554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4677d5-c359-4caa-99bb-43d7e94cd82a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:02.789229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:02.791000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 331/664] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:02.792612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:02.795560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.835881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.836571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.836859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.837137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.889675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:02.896725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedef818-adb7-4fcb-be0a-d52ccaf7ff5c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:02.913390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:02.914905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:02.931345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:02.932078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:02.932399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:02.932682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:02.944055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:02.951778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:02.953581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 332/665] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:02.954432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.020227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.029448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 334/666] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:03.030129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.064420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957397c6-d2a0-4d35-9a8a-e0713085d8ec None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.105301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.106293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.106738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.107165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.108350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.108835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.111557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.114052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.128170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 333/667] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.129411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.137768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c690ac6-331f-4b4d-b908-2b50818c031b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.174858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.175522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.175907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.176104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.176917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.177253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.178711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.195825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 335/668] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.195825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.253255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac6ad3-641b-4d1b-b693-e3dca81deec7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.278423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.288882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.289551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.289936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.290114 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.291110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.291414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.292818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.305706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 334/669] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.305706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.311328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19787b75-c60a-4bd4-a05a-081691107e86 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.347863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.348692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.348973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.349249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.358448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.361581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.363033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:03.380665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:03.381621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:03.382504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:03.382504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:03.382504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:03.382504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:03.382504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 336/670] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:03.382773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.412358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e779f-82aa-45f7-bc34-9fd9d4d50d22 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.455524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242494-d223-491d-8321-83c6226a5808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.456563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242494-d223-491d-8321-83c6226a5808 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.456857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242494-d223-491d-8321-83c6226a5808 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.457140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59242494-d223-491d-8321-83c6226a5808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.466534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242494-d223-491d-8321-83c6226a5808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.469298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59242494-d223-491d-8321-83c6226a5808 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-59242494-d223-491d-8321-83c6226a5808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:03.489846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:03.490788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:03.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:03.492767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305baaef-26b0-487e-8cc2-9fd32c33ad14 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.492843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 335/671] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:03.492843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242494-d223-491d-8321-83c6226a5808 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.527581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.528403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.528688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.528957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.536274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.537731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.544452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:03.552902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:03.559318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 337/672] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:03.560264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.597326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59242494-d223-491d-8321-83c6226a5808 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.607246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.631339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.632186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.632474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.632750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.642787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.644275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.652586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5876a-3693-4546-8b29-5f1114bb388b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:03.661879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:03.662935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 336/673] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:03.663844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.687366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.688027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.688344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.688626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.689347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.689656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.691023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89849d92-f65e-4655-ab00-07c61353548f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.702096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 338/674] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.703388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216990e0-bee3-465d-bbf5-f78b69676c89 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.703681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216990e0-bee3-465d-bbf5-f78b69676c89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.703962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216990e0-bee3-465d-bbf5-f78b69676c89 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.705362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 339/675] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:03.705993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216990e0-bee3-465d-bbf5-f78b69676c89 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.767924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfd714-f318-4ec1-a5da-79e8e78c280c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.802030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.802686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.802976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.803254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.804042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.804383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.805813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.806843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216990e0-bee3-465d-bbf5-f78b69676c89 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.818696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 337/676] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.819376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.824010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:03.845569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.846231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.846518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.846795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.847591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.847905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.849414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.861431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 340/677] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.862307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:03.918868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d83f4-6bdb-4076-b7cd-a19baa7719d2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.951327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.951985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.952301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.952583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.953839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:03.954148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:03.955534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d32e60-51fd-46e5-8337-0dc7348a7c65 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:03.957594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5aba58-c59b-41d7-95c1-4f180dc51c69 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:03.967738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 338/678] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:03.969515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.969802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.970078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.984962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:03.986150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:03.990624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:03.991406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:03.991686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:03.991958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:03.999752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.003125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.004690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:04.018793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:04.021131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 341/679] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:04.022020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.051877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.054456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 339/680] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:04.055299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.120278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b689c-22e2-43a5-8ce3-a106b370a505 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.152412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272e9c8-510a-45b8-a7ee-b66359e4c0a6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.154034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.154689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.154969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.155250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.156730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=c342400998514fe5beb96566fba15918) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.157048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.158486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.164264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 342/681] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/role_assignments?user.id=c342400998514fe5beb96566fba15918&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.165148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.190346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.191557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.192002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.192509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.193379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=8bc8f7da375441049d3975f1b80951a9) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.193702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.195182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.201967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 340/682] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/role_assignments?user.id=8bc8f7da375441049d3975f1b80951a9&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.203683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.230130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.293434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.301317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e19fc-d31f-40f3-9ec2-1f649e4a9778 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.348097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.349091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.349683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.349801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.359491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4714a13-31b3-4b13-a14f-b8cfe6104523 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.359719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.361431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:04.381016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:04.382209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:04.383390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:04.386499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 343/683] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:04.387466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.405328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.406175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.406583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.406914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.407787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.408096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.410487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.425219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 341/684] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.426375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.507434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24940f67-4e20-4e96-b7dd-0b4fea63c72d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.512536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.545256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.547166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.547454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.547729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.553217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c462497-18fa-4364-b0c6-dc60aa8eb1cf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.563974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:04.576648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:04.577854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:04.578790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 344/685] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:04.579480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.600600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.601836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.602300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.602952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.603380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.605376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.605951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.608247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.632305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 342/686] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.633825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.695908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b56a122-e7ce-4037-a9dd-f95345ff00aa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.731043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.731998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.732490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.732939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.733965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=f30afe81d08546e5b56ab490893ef303) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.735016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.736674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.743204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 345/687] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/role_assignments?user.id=f30afe81d08546e5b56ab490893ef303&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.744381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.761107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1eb9d-a442-41b1-a004-d5884edcc944 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.814197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.823099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:04.825284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:04.825599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:04.828499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:04.829411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:04.829824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:04.832051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:04.851502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 343/688] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:04.857979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:04.935293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:04.967245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2061e-9398-4063-ab4e-05177958e9c6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:04.998526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545875-0f03-4662-99bb-111d324e6746 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.022109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.022800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.023372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.023729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.044410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.045324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.045675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.046017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.059767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.061577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:05.079598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:05.080721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:05.081808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:05.081808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:05.081808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:05.081808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:05.088136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 344/689] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:05.088136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.112808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.115135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.141517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:05.206857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1585073-ffcf-4286-b958-53d9ff479494 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.214092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:05.242085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 346/690] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:05.242704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.243548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.243903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.248333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.248333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:05.248333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.248333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.251094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.261955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 345/691] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:05.267209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.416282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea94d62-a8a0-4a31-8143-8bb887da2478 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.444917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881aae5-da22-4d48-b197-700e851f0769 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.461878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:05.462180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.462994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.463278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.463558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.483187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.484303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.484731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.485148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.493793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.495463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.497351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.499798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:05.513356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:05.514496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:05.516216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:05.519658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 346/692] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:05.529080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:05.531735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:05.532861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:05.533935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:05.533935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:05.533935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:05.533935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:05.536238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 347/693] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:05.538707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.577564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:05.687707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d24876c-d151-4056-a88b-4bbf9c1dc19e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.698036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d497bc9-273d-4491-ba7c-11ef4aced75d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.729152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.730181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.730669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.731146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.732218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:05.732755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.734435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.754943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 347/694] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:05.761092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.784847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.785489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.785770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.786041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:05.786769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:05.787079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:05.788585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:05.794498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:05.809850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 348/695] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:05.817666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:05.892709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347596c9-738f-4646-b3e9-a07c1e9231d8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:05.932486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:05.933520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:05.934203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:05.935524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.014429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.016855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.041814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.061160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.082107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940b22a-ac5d-42d4-9809-b4a3c62e3348 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.132530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 348/696] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:06.145209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.196871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.197695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.197980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.198256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.217272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.219253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:06.244862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:06.245830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:06.246718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:06.252726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 349/697] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:06.257881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.269748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa700309-eff9-4316-ada9-b10dce5d6def None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.293460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.310293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.311101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.311390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.311661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.328804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.330260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:06.368609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:06.369834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:06.370809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:06.370809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:06.370809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:06.370809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:06.370809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 349/698] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:06.378009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.494791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120f4ca-9686-4736-bfd0-0c6ebcb5d50a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.515565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd0ff5-149c-41d9-a191-200878524c8c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.530587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.531825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.532127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.532423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.533156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:06.533464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.534894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271afe50-d06d-43df-bcfb-7da3433eeedc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.548137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 350/699] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:06.552153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f702-683e-4ce2-b14d-a0d917ad1e4a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.552153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f702-683e-4ce2-b14d-a0d917ad1e4a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.552153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978f702-683e-4ce2-b14d-a0d917ad1e4a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.552153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 351/700] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:06.556932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978f702-683e-4ce2-b14d-a0d917ad1e4a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.578743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.579649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.580089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.581121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.582413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:06.582886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.585572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcea2be-0660-42ae-a88f-c067c5cadd3c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.595758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.602872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 350/701] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:06.605104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.610522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.610522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.628904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:06.630926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:06.640317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.667715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978f702-683e-4ce2-b14d-a0d917ad1e4a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.703852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.704659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.704944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.705224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.705508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 351/702] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:06.712306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.713265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.713752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0ba25319-e934-4873-bb6c-c07bee35e00d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:06.729299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:06.730418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:06.731468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 352/703] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:06.732056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79806c-5612-42ae-bb43-7afae8cb5a9a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.732056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79806c-5612-42ae-bb43-7afae8cb5a9a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.732504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79806c-5612-42ae-bb43-7afae8cb5a9a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.733914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 353/704] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:06.737171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79806c-5612-42ae-bb43-7afae8cb5a9a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:06.829937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8bc90-2fc1-424a-8691-f3ec27556a1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.848628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.856265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79806c-5612-42ae-bb43-7afae8cb5a9a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:06.867169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.868129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.868435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.868716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.869724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=57d606342e46439f8f1274278438fb1c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:06.870406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.872159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756bc5-0451-49b8-910e-7b22a75a5e1a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.887149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 352/705] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/role_assignments?user.id=57d606342e46439f8f1274278438fb1c&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:06.896287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.896287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.896287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.898394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:06.899349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:06.899750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:06.900266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:06.901316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:06.902862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:06.907823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:06.916938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:06.926328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:06.926462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:06.927432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:06.928851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 354/706] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:06.929764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.016308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 353/707] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:07.017604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.061399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d788b-046c-4149-91b2-54478b0bd718 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.102290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.103298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.103805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.104285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.105250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:07.105782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.107411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.122484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 355/708] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:07.123270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.142416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.146241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379717f3-944a-4890-8f7f-32bb40dd3fec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.191753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.192465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.192750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.193028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.193740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:07.194051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.195432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.197344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.201667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 354/709] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:07.201667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.255515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032c377-0cbf-49ba-83cb-993a4cab04a8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.296869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.297910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.298394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.298826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.310283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.311932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:07.331455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:07.332600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:07.333727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:07.333727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:07.333727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:07.333727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:07.335586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 356/710] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:07.336558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.341950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798d1f5-dd40-49db-9df7-9fd01e2ad754 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.387702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.388455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.388834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.389441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.391369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:07.391779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.393404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.402130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 355/711] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:07.403056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.423691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.462695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccd5e8-6a2f-4e5b-b5d8-c2a4b5baad95 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.497593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.502235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.503046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.503482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.503666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.504425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:07.504737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.506317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a127f0b5-0de1-495b-974e-5385ba88487c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.517735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 357/712] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:07.519467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6902d-7734-4e57-8c37-47c2b2e11068 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.520092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6902d-7734-4e57-8c37-47c2b2e11068 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.520092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6902d-7734-4e57-8c37-47c2b2e11068 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.530325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 358/713] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:07.544143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.544143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.544143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.556277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6afa9-3b20-4b29-8bb9-154e47325b2e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.579134 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:07.580430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:07.613676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.614369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.614656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.614934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.615690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:07.615998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.617456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.651969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 356/714] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:07.668344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.675980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 359/715] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:07.706636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.775783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.809349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a047f3ae-2b64-48ba-bc69-342a422476fd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.825087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80dc56f-7cab-4033-aab7-427caba28218 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:07.838240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:07.849277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.850040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.850463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.850800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.851571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.853267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.899681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:07.900525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:07.900809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:07.901098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] PATH_INFO: `/v3/services/network` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:07.902166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:07.903635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:07.917225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:07.918250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:07.919083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 360/716] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:07.924975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:07.933873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 357/717] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:03:07 2022] POST /identity/v3/users => generated 254 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:08.075355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3aee2-e11a-4eb2-87c1-2e7ebfa82918 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:08.128531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:08.137811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:08.141314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:08.141314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:08.141314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:08.141314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] RBAC: Adding query filter params (name=network) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:08.141314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:08.142195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6152ad-d94a-4ac0-87fa-36cb8ba1bddf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:08.148573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 361/718] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:08.153909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:08.290289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734b48-4d69-4678-8d47-99f9e2e3675d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:08.334708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:08.335393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:08.335677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:08.335950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:08.336709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:08.337005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:08.338431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0c287-d8d5-431e-89ec-4dfe47bd6f7c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:08.345028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 358/719] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:09.361692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591bbf-eeac-407c-9ff5-155d64cb8108 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:09.362215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591bbf-eeac-407c-9ff5-155d64cb8108 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:09.362319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea591bbf-eeac-407c-9ff5-155d64cb8108 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:09.363865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 362/720] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:09.369294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:09.369701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:09.369875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:09.392776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:09.393951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:09.444752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:09.477346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 359/721] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:09.518495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591bbf-eeac-407c-9ff5-155d64cb8108 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:09.635131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea591bbf-eeac-407c-9ff5-155d64cb8108 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:09.685930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:09.686733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:09.687561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:09.687841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:09.701045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:09.710180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:09.711129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:09.711981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 363/722] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:09.721346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:09.826456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79860f3-2a1d-4fac-a83c-eca1c7914ed2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:09.862996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:09.863679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:09.864391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:09.864671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:09.867628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:09.867628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:09.867628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01d33c8-8a45-4783-bb2e-229b6642a517 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:09.877407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 360/723] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:09.883613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:09.956236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.010350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03cf6c-1a21-48e3-81e4-34ec692c4436 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.035381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47cb0-4491-4859-b681-fc29327a4629 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.035689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47cb0-4491-4859-b681-fc29327a4629 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.035931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc47cb0-4491-4859-b681-fc29327a4629 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.037830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 361/724] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:10.045515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a514d-1fd9-4a30-b19d-9bb18214c9b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.045794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a514d-1fd9-4a30-b19d-9bb18214c9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.046063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a514d-1fd9-4a30-b19d-9bb18214c9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.065531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.066350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.066637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.067034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.088155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be5a514d-1fd9-4a30-b19d-9bb18214c9b2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:10.090320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be5a514d-1fd9-4a30-b19d-9bb18214c9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:10.093302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.095604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2ae53505-489f-4220-bafc-3dd200750642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:10.114195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:10.115127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:10.116570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:10.116570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:10.116570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:10.116570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:10.116570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 364/725] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:10.121479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743535df-8e1c-4e56-a122-c537bb3bdbfa None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.121773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743535df-8e1c-4e56-a122-c537bb3bdbfa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.122050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743535df-8e1c-4e56-a122-c537bb3bdbfa None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.127902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 365/726] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:10.127902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743535df-8e1c-4e56-a122-c537bb3bdbfa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.131506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.180478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 362/727] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 18:03:10.182428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.182924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.183428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.210510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:10.211552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:10.256339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743535df-8e1c-4e56-a122-c537bb3bdbfa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.259762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.304288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 363/728] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:10.305547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.311045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.311721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.312536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.312812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.316404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:10.316783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.318159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.336332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 366/729] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:10.337603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.438478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.445171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b60df2-8235-4df7-93ec-13b74e9fd3c3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.463022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f4be9-8bc7-4ffc-a0ea-bd33534daa3a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.490480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.491158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.491445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.491723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.492634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.494619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.502691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.503780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.504332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.504834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.516262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:10.524404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:10.525491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:10.526521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:10.528602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 367/730] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:10.529609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.561051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.608689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 364/731] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:10 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:10.608689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.692359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03511c74-a58c-472f-9a12-4e9acd248878 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.744663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.745388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.745784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.745959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.755130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.756428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.765542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e6a2bb-3722-41ed-b1eb-f3e5e88f4112 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-828e49eb-3789-4219-ba05-bde22af8ffe5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:10.771801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:10.772863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:10.773809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:10.777913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 368/732] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:10.779335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a939acf-dc70-42a8-af3e-a4e79c107f3e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.779634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a939acf-dc70-42a8-af3e-a4e79c107f3e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.779917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a939acf-dc70-42a8-af3e-a4e79c107f3e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.781610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 369/733] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:10.782348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a939acf-dc70-42a8-af3e-a4e79c107f3e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.821844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.822630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.822916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.823191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.823946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:10.824278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.825651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903aada-f2cd-46ed-850e-ad1de2a2070c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.840540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 365/734] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:10.842163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.842623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.843073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.861843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:10.863017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:10.879188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.891505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:10.911288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a939acf-dc70-42a8-af3e-a4e79c107f3e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:10.947984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551459b-45e0-429f-a138-628de13be803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:10.948703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551459b-45e0-429f-a138-628de13be803 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.949107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551459b-45e0-429f-a138-628de13be803 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.949303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551459b-45e0-429f-a138-628de13be803 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.950381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551459b-45e0-429f-a138-628de13be803 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:10.950511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551459b-45e0-429f-a138-628de13be803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:10.952005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551459b-45e0-429f-a138-628de13be803 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:10.956327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 366/735] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:10.957136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:10.972077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 370/736] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:10.973581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced006b4-f184-4b45-92e9-4b6566afb0b4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:10.973880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced006b4-f184-4b45-92e9-4b6566afb0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:10.974167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced006b4-f184-4b45-92e9-4b6566afb0b4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:10.975694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 371/737] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:10.977317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced006b4-f184-4b45-92e9-4b6566afb0b4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.065478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253445c0-1dbc-41a8-9dd8-7d869762802b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.081926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced006b4-f184-4b45-92e9-4b6566afb0b4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.102442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.103243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.103518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.103789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.114571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.116039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.119247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.120221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.120777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.121267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.124192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.132001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-323d0532-530f-4d12-91b7-92a88059e892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:11.133444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:11.135405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 367/738] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.136356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.136762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.153035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:11.154244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:11.203859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.205443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.228591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 368/739] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 18:03:11.228591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.317519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 372/740] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:10 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 18:03:11.317519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.337760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae01e5a-84f4-49b1-b095-30bb873d1bcb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.356518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.369352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.375827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.376813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.377252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.377660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.388704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:11.397080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:11.398071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:11.398916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 369/741] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:11.399615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.427318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf08d64-2caf-43c3-ae02-356c54833b55 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.463282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.464699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.465172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.465618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.466521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:11.467015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.469195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.480706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 373/742] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:11.481743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.509662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71fa179-b782-49df-9931-5b0cb912a0bd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.544512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.545173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.545453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.545727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.546477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.547847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.581690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.585088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e008c4-b253-4dc0-8def-714baeac2334 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.616856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.617667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.617944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.618215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.628141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.629617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.644142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 370/743] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:11 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:11.644142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:11.658839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:11.659812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:11.660762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:11.660762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:11.660762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:11.660762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:11.661140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 374/744] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:11.661953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.712141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.766350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29244b-7e1c-4db5-ac01-03d6e3f0218f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.802902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082b23c-3cef-4212-9787-6f445d53fa05 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.815290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.815998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.816312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.816590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.817383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:11.817697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.819773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.830124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 371/745] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:11.831383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.843635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:11.844387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:11.844670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:11.844944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:11.855530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:11.857498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:11.874010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:11.875589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:11.876583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:11.877130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 375/746] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:11.878178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:11.892168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.968379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b92b9-2b73-40de-b2f0-117cbbe2cced None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:11.980784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:11.993282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b0bec-9cf3-4600-bc1c-09e1ecf574eb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.010518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.011411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.011837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.012283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.013242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.013692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.015801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.033184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 372/747] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.033184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.041297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.042372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.042982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.043452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.056362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.058196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:12.077203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:12.078127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:12.079020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:12.079020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:12.079020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:12.079020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:12.081087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 376/748] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:12.082093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.150168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.159332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194cdb0-7079-4290-a2fc-1b6bc833bd3e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.194543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ac7c6-20df-46a4-a6ef-5b6c93f26e19 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.209197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.209871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.210396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.210679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.211989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.212401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.214199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.235683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.236893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.237396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.237640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 373/749] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.238128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.238483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.250690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.252168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:12.266945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:12.267904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:12.268812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:12.272882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 377/750] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:12.273753 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.279184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.357303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a8aad7-ff4b-4b41-b5ff-450d14f6a1c1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.377226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7ab71-b289-4563-a8cc-8cb8b50f7020 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.401101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.406147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.407310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.407920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.408395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.409850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.410429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.415829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.415938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.415938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.415938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.415938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.426567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.428001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 374/751] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.428368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.429347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:12.449388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:12.450536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:12.451615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:12.451615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:12.451615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:12.451615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:12.457809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 378/752] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:12.458837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.535760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.555924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d57e-8024-4746-8c04-f73daae25057 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.569228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115641b-6194-4035-9cd6-f38e0c0641b9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.595762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.596657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.597066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.597555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.598380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.598815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.600555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.613191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.614207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.614635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.615055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.619768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 375/753] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.620879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.623341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.626265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:12.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:12.646953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:12.648128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:12.650999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 379/754] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:12.652300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.697268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.737329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e706a-b5d1-490e-89fe-1611e46ff963 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.773853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.774524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.774812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.775099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.775829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.776156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.777536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.786103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7a2b5-861f-4d61-95b8-15846ebba34e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.790078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 376/755] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.790997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.801006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:12.834760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.835431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.835723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.836005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.836888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=57d606342e46439f8f1274278438fb1c) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.837206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.838655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190e242-3964-453d-a42a-49156d1ec265 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.844927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 380/756] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/role_assignments?user.id=57d606342e46439f8f1274278438fb1c&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.857786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1610-3498-4098-bc86-89b84ff768a0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.858144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1610-3498-4098-bc86-89b84ff768a0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.858781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae1610-3498-4098-bc86-89b84ff768a0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.859916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 381/757] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:12.860645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1610-3498-4098-bc86-89b84ff768a0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:12.914312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3b537-ce23-452a-9a3f-15c5337a5b46 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:12.957111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:12.957780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.958064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.958336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:12.959184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:12.959489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:12.961003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a20b04-bb10-4873-a272-31c3c38b5bb9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:12.981827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 377/758] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:12.987804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:12.988140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:12.988389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.007642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:13.008861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.009586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:13.014553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae1610-3498-4098-bc86-89b84ff768a0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.066801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.068504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.069281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.069780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.073699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.080631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.082636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.083688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 378/759] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:13.084683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:13.099388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:13.101002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:13.101910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:13.108597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 382/760] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:13.109884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.221615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825f4079-1b33-45eb-a383-3a3284aa45d5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.235162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68080bf6-6649-4054-b364-37a0ad1dd2bb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.259783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.260784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.261328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.261925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.270556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.271396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.271679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.271953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.272707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.274076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:13.286612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:13.287587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:13.288475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:13.292488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 383/761] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:13.293403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.320196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.338404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.346701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.348468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.398694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49324923-44d3-4195-badb-5c800abf8cae None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.434315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.435047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.435254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.435527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.436350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:13.436659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.438327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.455397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 384/762] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:13.456351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.462681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 379/763] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:13.463819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.544690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.563752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b3d2b-4a5e-4596-976b-6b903f779f9a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.570389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.578599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e52f1d-d272-4ecd-bd2c-3d9bd1311f74 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.600334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.601058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.601387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.601674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.602375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:13.602677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.604055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.612468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 385/764] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:13.613455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.621748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.622905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.623466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.623953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.626297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=50043e6bb2414d7dbf9feecd1b1980bd, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.628010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.704414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 380/765] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:13 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:03:13.705774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.715954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb396fd3-b73d-489b-8f99-fff6052eb7cf None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.753186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.753998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.754327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.754604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.766455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.768040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.786977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-50230616-95c7-48da-ac4e-e82adf2b4687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:13.788488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:13.789577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:13.791019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:13.791019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:13.791019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:13.791019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:13.796295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 386/766] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:13.799497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144f20-5554-42aa-8ee2-443c1ee4cdea None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.799497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144f20-5554-42aa-8ee2-443c1ee4cdea None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.799497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53144f20-5554-42aa-8ee2-443c1ee4cdea None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.803033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 387/767] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:13.803932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144f20-5554-42aa-8ee2-443c1ee4cdea None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:13.879121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ca334-d406-452e-a80e-47922a4d4024 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.922011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.922809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.923091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.923394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.924097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:13.924432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.925946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5911df6e-f9d4-4adb-8437-a8a10e1e19aa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.932210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 381/768] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:13.933664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.933953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.934232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.936265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53144f20-5554-42aa-8ee2-443c1ee4cdea None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:13.953289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:13.954564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:13.971819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:13.980945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:13.985315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:13.998503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 388/769] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:13.999869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.040251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 382/770] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:14.041447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.065162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.119222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8451384-419a-4928-83a9-05f434a76cda None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.157716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa463e-726a-4c25-927c-059bc45edf8c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.163377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.164048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.164436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.164718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.166197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] RBAC: Adding query filter params (interface=public, service_id=29a85610a6e347cf984ead19410449af, region_id=RegionOne) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.166523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.168290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.178245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 389/771] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:13 2022] GET /identity/v3/endpoints?service_id=29a85610a6e347cf984ead19410449af&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.179072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.200265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.201128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.201468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.201808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.209660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.211172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:14.225870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:14.226776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 383/772] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:14.228462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.239499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.285258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97928127-7220-4ab5-93ce-62fa4a6ceea3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.309861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.322754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.323408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.323694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.323972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] PATH_INFO: `/v3/services/network` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.324742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.326058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.336933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73c470-5c0b-4284-8455-b538f33b650c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:14.338620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:14.339781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:14.340728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:14.344602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 390/773] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:14.345656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.377554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.378654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.379380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.380084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.380957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.382763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.400258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 384/774] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.401513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.456522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aee370-2eb1-4584-932a-471a1fa79ddc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.493781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.494583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.494932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.495279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.496180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.496559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.504298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.512166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 391/775] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.518639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.524020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.557460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877daa23-aed6-4d10-9bfd-33a4f9554351 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.572519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.600349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.600349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.600950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.600950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.601675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] RBAC: Adding query filter params (name=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.601993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.603382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.612074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 385/776] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.615409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.634906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e54ac-3134-4a3e-9470-a628b33588dd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.714508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.715601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.716091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.716655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.717734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=89c19949d79a43beb88b88662b0388f7) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.718313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.719956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.725927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e01e84-67a3-4d09-b17d-f4ee9d89ef7b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.726842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 392/777] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/role_assignments?user.id=89c19949d79a43beb88b88662b0388f7&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.766203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.766898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.767186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.767465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.768242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.768554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.769970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2f282-15e9-4812-90b3-f610077396ee None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.772552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.780263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 386/778] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.785146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.905931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504a294-b5fb-425d-874e-cd14c7f688b5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:14.917201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:14.926024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b42bc-0489-4736-a95f-1796faf681e8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.926313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b42bc-0489-4736-a95f-1796faf681e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.926593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b42bc-0489-4736-a95f-1796faf681e8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.929601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 387/779] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:14.934875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.939707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.939707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.952150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:14.952150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:14.952150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:14.952150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:14.953133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] RBAC: Adding query filter params (interface=public, service_id=543b36c91f0445f9ab71d5f419eb7b3c, region_id=RegionOne) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:14.953133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:14.953133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:14.958009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 393/780] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/endpoints?service_id=543b36c91f0445f9ab71d5f419eb7b3c&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:14.965069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:14.966752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:14.967984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:15.070279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c84319-f266-49e8-a93d-00b5dc7f7336 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:15.105719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:15.106410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:15.106696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:15.106972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:15.107682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:15.109827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:15.116299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 394/781] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:14 2022] GET /identity/v3/services => generated 772 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:15.122421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 388/782] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:15.157275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:15.215169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:15.283024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36daa5b9-bfe4-426d-badb-217547114f3d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:15.321471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:15.322277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:15.322561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:15.322837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:15.333641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:15.341361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:15.342273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:15.343159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 395/783] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:15.349140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:15.457961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cfbca-1a54-4ca9-a038-37a2cdd04c3d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:15.488843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:15.495195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:15.496173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:15.496655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:15.497123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:15.498141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:15.498639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:15.500264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:15.509270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 389/784] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:15.517799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:15.657037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:15.662089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e326b3e5-412e-4a5c-b854-d3347a5cee87 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:15.705729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:15.706777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:15.707229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:15.707664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:15.719610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:15.725365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:15.748041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:15.749218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:15.750316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:15.750316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:15.750316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:15.750316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:15.752216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 396/785] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:15.757947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:15.910933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8ec65-1f75-433b-8e9e-9c286e320aec None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:15.945546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:15.946206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:15.946486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:15.946756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:15.947475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:15.947778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:15.949175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:15.962034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 390/786] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:15.967520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.116333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683562ef-0ddb-4403-b4d1-b1694522fc1b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.157927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.159175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.159665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.160164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.169708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:16.171575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-00c913a1-8a8b-46a3-b8f8-1e372425186b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:16.187435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:16.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:16.189424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:16.192103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 397/787] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:16.197977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.265693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:16.319524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e1ef-7739-446f-9d17-068ed93a73d7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.319869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e1ef-7739-446f-9d17-068ed93a73d7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.320148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06e1ef-7739-446f-9d17-068ed93a73d7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.321736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 398/788] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:16.327986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.328304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.328497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869408bc-09f3-4a52-8a59-355b8d2f7cd9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.328601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.360813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:16.362008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:16.371584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:16.400824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.401504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.401794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.402074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.402923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:16.403233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:16.407416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:16.437253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 391/789] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:16.442312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.480766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 399/790] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:16.509567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.621253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3778bf-ffa0-4c79-9aea-21c68ce9690e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.632658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:16.657779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.658910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.659443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.659913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.671740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:16.673532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:16.679099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c722e-c7e7-4a37-bc6b-d1a70f14a121 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:16.692380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:16.693278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:16.694168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:16.694168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:16.694168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:16.694168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:16.696418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 392/791] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:16.705162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.725566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.728348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.728348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.728348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.745738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:16.748974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:16.756760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:16.763169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:16.764234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 400/792] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:16.768081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.890885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d6987-c063-4cdb-8032-bc3d49876a83 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.926049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31af9-dc0c-4b5f-be0e-3ebaeba4346c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:16.962730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.963764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.964312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.964815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.965766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:16.966292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:16.967895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:16.976716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 401/793] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:16.977773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:16.978669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:16.979149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:16.979620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:16.980616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:16.981124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:16.982285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:16.984183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.008458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 393/794] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:17.014564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.049013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.128028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c919f2-0ee4-47fe-baf1-9dbd5314a313 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.168564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.183339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.184412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.184872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.185583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.194511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.196744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c3d50af6-533f-4e68-9900-a6f8f5265ecc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:17.216212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:17.217162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:17.218086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:17.220905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 394/795] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:17.222416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a768-0c8c-47f5-b655-603410741faa None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.222843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a768-0c8c-47f5-b655-603410741faa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.223248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38a768-0c8c-47f5-b655-603410741faa None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.225217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 395/796] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:17.226256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a768-0c8c-47f5-b655-603410741faa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.235478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2380-b1dd-4103-9dd7-62428c5fb686 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.277737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.278547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.278843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.279111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.289804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.291529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-810c6957-25d5-41fe-b930-9d4f9dfd569a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:17.309184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:17.310104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:17.310993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:17.310993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:17.310993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:17.310993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:17.312707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 402/797] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:17.313777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.314064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.314341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.322076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.330828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:17.332677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:17.341200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38a768-0c8c-47f5-b655-603410741faa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.377264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.377935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.378216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.378494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.379287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:17.379599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.381072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0851c-cce1-45a8-beb3-67199878b219 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 396/798] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5f62-9528-4064-9714-a7e6d1ff3977 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5f62-9528-4064-9714-a7e6d1ff3977 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a5f62-9528-4064-9714-a7e6d1ff3977 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 397/799] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:17.397550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a5f62-9528-4064-9714-a7e6d1ff3977 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.424445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 403/800] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:17.425103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.479594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.510252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a5f62-9528-4064-9714-a7e6d1ff3977 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.536035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f97dd5-eac2-4887-95ff-bea9e6a0ac22 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.549873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.550958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.551758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.552352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.553099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:17.553409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.554879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7570ed-93b6-4eea-9ab7-5a7e428aa59f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.572364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 398/801] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:17.572364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.572364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.572364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.576382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.579854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091c2a-4510-4431-8679-81396b64022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.580778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091c2a-4510-4431-8679-81396b64022a None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.581063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091c2a-4510-4431-8679-81396b64022a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.581340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23091c2a-4510-4431-8679-81396b64022a None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/57d606342e46439f8f1274278438fb1c/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.583366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091c2a-4510-4431-8679-81396b64022a None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=57d606342e46439f8f1274278438fb1c, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.584880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23091c2a-4510-4431-8679-81396b64022a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.587687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:17.588901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:17.635249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 404/802] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:17 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/57d606342e46439f8f1274278438fb1c/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:03:17.636075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091c2a-4510-4431-8679-81396b64022a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.680230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 399/803] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:17.680230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.813803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ed109-6f8f-4cab-97ea-a4cbb8a85662 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.859695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.864828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.865634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.865923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.866199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.873579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:17.875078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-10155b92-0658-4d5d-8934-54d3d61a6738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:17.889492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:17.890445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:17.896852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:17.897396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23091c2a-4510-4431-8679-81396b64022a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 400/804] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc119c9-6604-40cb-b46a-4b6e9355945c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc119c9-6604-40cb-b46a-4b6e9355945c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc119c9-6604-40cb-b46a-4b6e9355945c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 401/805] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:17.897752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc119c9-6604-40cb-b46a-4b6e9355945c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:17.900475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:17.936838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:17.937606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.937888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.938164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.949094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dae1ed6f-b094-4023-9fa0-a48c34a6cb78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:17.957333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:17.958274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:17.959113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 405/806] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:17.960487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:17.960487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:17.960487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:17.977000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:17.978203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:18.010297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc119c9-6604-40cb-b46a-4b6e9355945c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.047379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 406/807] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:18.048435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.049248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.049534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.049811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.050471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.051852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.053333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:18.066184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:18.067163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 18:03:18.068000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:18.072255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 402/808] 10.222.0.33 () {56 vars in 1129 bytes} [Tue Jul 12 18:03:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:18.073118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.148805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.169721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.178056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a289e41-ad44-463b-97bd-041c023987f4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.204412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f756e0-e886-4d02-830c-778515ab48a0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.215865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.216951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.217434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.218481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.219503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:18.220018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.221820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.240244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 407/809] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:18.241423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.251730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.252914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.253207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.253487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.254264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:18.254574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.255981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.274331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 403/810] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:18.274331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.368601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b00a90-ac36-44a2-99e5-5f4f045c6d4a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.398922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d90225-2136-41b4-a22a-fa69980694d7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.404236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.405127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.406045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.406383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.407108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.408583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.417855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:18.420919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:18.421954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 18:03:18.422815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:18.427077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 408/811] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:18.428005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.440611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.441488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.442215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.442790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.443749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:18.444250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.446416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.448459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.453685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 404/812] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:18.454858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.572202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e55a7a-8255-40f2-976a-87dbb4e53800 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.581931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d23a18-82b9-49e8-9fc1-2177108f43c4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.609224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.610021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.610309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.610590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.618322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.618975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.619260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.619535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.621495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.622961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:18.641083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:18.641981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:18.642864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:18.642864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:18.642864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:18.642864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:18.642864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 405/813] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:18.643149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.679036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.693701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.695152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.712789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.806397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 409/814] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:18.807383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.885413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63bc929-ee3c-4876-af86-3cc6d3a8cbf3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.919245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.919887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.920195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.920479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.920836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4af4a-ffca-4e30-a58e-86c5db4c1b5c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:18.921886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:18.921975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.923341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.927934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 406/815] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:18.928738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:18.948771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:18.966421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:18.967025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:18.967316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:18.967598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:18.968360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:18.968671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:18.970047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:18.975200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 410/816] 10.222.0.33 () {56 vars in 1124 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:18.980291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.031656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.035810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf274e-8a06-4863-90e9-903e914600d1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.071920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.072606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.073096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.073208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.073852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:19.074148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.075506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.081856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879f1dc-73ad-4732-9b43-f4887f736e6e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.086733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 407/817] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:19.087774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.119726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.120549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.120850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.121102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.132604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.134041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:19.152341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:19.153330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:19.154215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:19.154215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:19.154215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:19.154215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:19.154215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 411/818] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:19.154498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.187597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.203489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10aac02-f217-4499-9d06-eb5c77ea7ba8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.238570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.239159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.239438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.239717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.240440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:19.240743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.242107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.247530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 408/819] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:19.248346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.264382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b9f65-979b-49b3-8695-bdfae99c4129 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.273935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.300163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.300828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.301107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.301381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.302112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.303518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.349698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe9d652-1b08-44a5-ba63-dbba0992c318 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.382906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.383718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.384000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.384302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.391272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.392755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.396904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 412/820] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:19.397992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:19.425868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:19.427783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:19.429701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:19.432711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 409/821] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:19.434213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.542424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.563403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.568649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbfa4e-f85a-4c47-a38a-450172926cc1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.593869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e1a34-3669-4e83-861d-3211c8412af7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.609617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.610287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.610567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.610843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.611565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:19.611873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.613413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.628080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 413/822] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:19.629017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.634354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.635268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.635694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.635970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.636737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.638102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.733918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 410/823] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:19.734766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.750675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb12f3-4059-4e04-a69c-26a1f7783a2b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.800497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.801328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.801688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.802083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.803167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:19.803554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.805131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4418b6-157e-4018-a209-d4de68d8be87 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.821684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.832748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 414/824] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:19.834552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6344a-d078-416b-a64f-d2085be948b3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.835032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6344a-d078-416b-a64f-d2085be948b3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.835402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6344a-d078-416b-a64f-d2085be948b3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.840741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 415/825] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:19.840741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6344a-d078-416b-a64f-d2085be948b3 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:19.888421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b4a02b-d079-449e-9fca-5a362e1340cd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.945881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:19.952176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.952176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.952176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:19.957377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:19.960189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:19.963162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:19.970281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6344a-d078-416b-a64f-d2085be948b3 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c92e448-7eb1-4be8-81df-ac1073cb8cdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:19.977843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:19.978988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:19.980055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 411/826] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:19.980755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:19.981041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:19.981316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.003472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:20.007128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:20.019151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.019953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.020274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.020553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.031798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.033575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:20.051727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:20.052887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:20.053996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:20.053996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:20.053996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:20.053996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:20.055594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 416/827] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:20.056545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.081760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 412/828] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:20.084981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.111904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.164457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683f6aa-9b58-442f-bf38-5f67b6f678f7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.193494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4526429-c21f-4c5d-910f-359591df1d0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.201338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.202003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.202317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.202592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.203727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.204038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.206117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.221016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 417/829] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:20.221974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.226724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.235571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.241275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.251297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 413/830] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:20.256441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.332476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9202d-5e9b-4c80-8ed8-998dec78c179 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.344210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.362647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b34cc-8fb7-48d7-ac39-68dc23b8b6ec None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.370468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.371293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.372171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.372893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.383483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:20.391648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:20.392888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 418/831] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:20.393735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.402767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.403422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.403710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.403984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.404862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.405230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.407220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.413410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 414/832] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:20.414051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.478517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.531830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77248dcd-a0aa-4d99-86e1-ccb5b0d82a14 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.551356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c0f8a-74c4-4428-8076-9b5374221441 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.573122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.573802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.574089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.574370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.575131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.575440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.577012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.587285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 415/833] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:20.593872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.599780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.600912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.601343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.601763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.610578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.612408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:20.627514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:20.628709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:20.629809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 419/834] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:20.637039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.677268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.718094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d49a54-58fe-44af-b432-8cc55b9d8ed9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.733135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.754158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.755287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.755661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.756029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.757783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b98a9-5e05-49ae-a20e-bdb34bedc7ef None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.767519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.769124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:20.786700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:20.787770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:20.788861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:20.788861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:20.788861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:20.788861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:20.790628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 416/835] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:20.795983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.799899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.800763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.801193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.801671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.802687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.803142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.804760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.823467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 420/836] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:20.825023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.900310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf3c63-be63-4479-8daf-8dd0665aecfe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.926268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.935462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.936313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.937219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.937588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.938478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:20.938971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.939096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083f727-4792-4cb5-a95c-97f3e873974f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:20.940473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:20.957653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 417/837] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:20.959329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:20.977920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:20.979393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:20.979838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:20.980339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/89c19949d79a43beb88b88662b0388f7/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:20.986861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:20.997353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=89c19949d79a43beb88b88662b0388f7, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:20.999602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.055386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 421/838] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:20 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/89c19949d79a43beb88b88662b0388f7/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:03:21.064914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1965274-1f61-4990-a7a5-92304fb96ec0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:21.103809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:21.104660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.104940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.105211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.114422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:21.115897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:21.132247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:21.133254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:21.134623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 418/839] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:21.139481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.253337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02406757-88ac-4c06-94dd-04c8a1aef085 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:21.287975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:21.288719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.289011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.289281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.290120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:21.290691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:21.292145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ba39c8-dedd-4ec5-be15-dd8b278a6d02 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.301622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:21.311968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 422/840] 10.222.0.33 () {56 vars in 1135 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:21.317911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.405283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:21.420007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a33f96-4b8d-4718-8567-2e4d4021a4b9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:21.455126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:21.455776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.456058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.456363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.527575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:21.528987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.567325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e6cb-df7a-4ecc-92a9-36c148f65c08 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.567671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e6cb-df7a-4ecc-92a9-36c148f65c08 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.567898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1e6cb-df7a-4ecc-92a9-36c148f65c08 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.569569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 423/841] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:21.574561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.574842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.575117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.597608 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:21.599343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:21.629103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:21.651120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 419/842] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:21.657130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.697105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 424/843] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:21.718945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.766790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d748da-59db-4b51-a795-c8c1ec2750a6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:21.822875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:21.824209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.824750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.825299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.826214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8060061-3166-4690-b6e4-dfb637559af4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:21.841858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:21.844214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.855879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:21.864769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:21.864937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:21.869264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:21.870144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:21.870144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:21.870144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:21.870144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:21.870375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:21.870375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:21.870375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:21.870553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 420/844] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:21.870651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:21.871255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:21.872806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:21.884049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:21.885065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:21.886188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:21.888648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 425/845] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:21.894447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:21.924593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:21.999546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495d188d-385d-4f9f-bc57-5f7c601f5fa6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.022985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16359c-d732-4c08-b40d-1054c2bb678b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.045766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.046615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.047002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.047279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.048007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.048340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.050420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.060908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.061894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.062386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.062867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.063795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.064346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.065277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 421/846] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:22.066145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.070412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.076885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 426/847] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:22.078289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.134746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:22.193580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:22.193780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcec49-405f-444d-aad3-a9b13b7bc477 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.199399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2df5f-d4f9-407d-99ab-072079de0c3f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.240970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.242065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.242215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.242502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.242921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.243620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.244027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.244361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.244547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.245009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.247179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.254031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.255870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.260367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 427/848] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:22.276317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:22.277304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:22.278242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:22.281177 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 422/849] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:22.287208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.399291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbafa3e-279b-4649-b3ac-6836b2873f6f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.421213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:22.435442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.440295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35b442-70a0-4b65-8e82-9a844e68f658 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.452950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 428/850] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:22.458595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.537355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6fbf4-221b-421c-a9ed-a98a828dd2a7 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.537660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6fbf4-221b-421c-a9ed-a98a828dd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.537906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6fbf4-221b-421c-a9ed-a98a828dd2a7 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.539508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 429/851] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:22.544700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.544986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.545263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.565245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:22.566448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:22.569799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b8ac-bf2d-47b5-b850-9e280b59ef1d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.605042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.605691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.605972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.606241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.607206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=57d606342e46439f8f1274278438fb1c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.607515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.609636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.620037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 423/852] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/role_assignments?user.id=57d606342e46439f8f1274278438fb1c&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:22.646455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 430/853] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:22.669911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.699223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:22.781203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab11c5a-2abf-4843-934d-e40e640b7bca None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.822368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.823433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.823740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.823997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.824689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.826071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:22.840238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:22.841196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:22.842048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 424/854] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:22.849273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:22.956671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc55859b-2caf-4078-8007-24a1e52b0aa4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:22.968386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:22.992110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:22.992824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:22.993103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:22.993377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:22.994087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:22.994398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:22.995769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e90025b-0bd0-4eb2-8da3-357d733cb52c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:23.001074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 431/855] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:23.006641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:23.096480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:23.116589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eedde2-8a70-4ae3-af19-b0ccc770a2b4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:23.150085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:23.150755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.151036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.151313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.152024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:23.152359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:23.153727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaf930-3ef3-4fe3-b7f2-ebfaaa3ba9d3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:23.160744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 425/856] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:23.298640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032dcd-e829-4e83-b01e-d22e371d1db4 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.299161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032dcd-e829-4e83-b01e-d22e371d1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.299242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82032dcd-e829-4e83-b01e-d22e371d1db4 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.300889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 432/857] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:23.306203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.306720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.307188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.324863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:23.326063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:23.400938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 426/858] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:23.425229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82032dcd-e829-4e83-b01e-d22e371d1db4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:23.528963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82032dcd-e829-4e83-b01e-d22e371d1db4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:23.564330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:23.565470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.565965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.566432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.576879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:23.585249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:23.586162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:03:23.587008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:23.594329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 433/859] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:03:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:23.596575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:23.696567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:23.705739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66728ba8-8df5-40bd-be82-077c3f4407ed None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:23.739686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:23.740408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.740692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.740967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.741775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:23.742084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:23.743519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:23.752863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 427/860] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:03:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:23.758407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:23.805598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:23.863095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f477b78-d0d4-497f-ad86-e801dc18e737 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:23.903537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:23.904369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:23.904655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:23.904931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:23.916849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:23.918352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:23.935525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:23.937079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:23.937954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:23.937954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:23.937954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:23.937954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:23.941881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 434/861] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:23.943405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.047904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065d5e04-544b-415c-a679-279023e1cb18 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.082222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.082808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.083090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.083363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.084166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:24.084477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.085899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.097940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 428/862] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:24.103161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.189831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.204282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a116d2-21e0-4864-947b-680b48ce5014 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.238061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.238890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.239177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.239456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.248543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.250578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a21988a7-9dac-4568-b6e6-02faafcc1e70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:24.266535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:24.268749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:24.270974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:24.276402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 435/863] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:24.276567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.276916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.377418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fac670-359c-4e2e-bcbb-cad48f5f90f1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.419245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.419736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b4eaa-1b38-434a-b8d2-dfc747b8671b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.420209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.420290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b4eaa-1b38-434a-b8d2-dfc747b8671b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.420376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.420449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58b4eaa-1b38-434a-b8d2-dfc747b8671b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.420518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.421911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:24.422254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.423702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.424254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 436/864] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:24.427481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.427775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.428049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.443831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 429/865] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:24.450092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:24.450862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.451285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:24.518499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.528223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 437/866] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:24.542484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.553786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6a07e-c20d-489a-b537-c53d07a4d097 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.588564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.589460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.589985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.590478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.625122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.647736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b9546d-2379-49bd-a135-e72314b90631 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.662178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.663892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a624f774-9a20-4ce6-ad43-a177cc5de1ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.683746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.684446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.684730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.685007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.685728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.687132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.725239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.747563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 438/867] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:24 2022] POST /identity/v3/services => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:03:24.782906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 430/868] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:03:24.789210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:24.849693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c149-b98d-42f7-a9f9-5120e28dc615 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.850030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c149-b98d-42f7-a9f9-5120e28dc615 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.850266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8c149-b98d-42f7-a9f9-5120e28dc615 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.852028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 431/869] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:24.857753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.858053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.858394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.888704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:24.891126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:24.918944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a215d-0ee8-45d8-abbe-c918a9906bc1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:24.955206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:24.963389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:24.963389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:24.963630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:24.964095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:24.976054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:24.977879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:24.987827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 432/870] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:24.997868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:24.998784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:25.000062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:25.000062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:25.000062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:25.000062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:25.000062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 439/871] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:25.005003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.010133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.103573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.113051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f045b09-3de1-4dcf-8f20-a84c301600de None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.143330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9190c34-f110-4c32-9da8-8b2e65b0f4a3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.147017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.147693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.147977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.148396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.149151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:25.149469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.150854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.163342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 433/872] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:25.169093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.186172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.187496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.187855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.188053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.188754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.190127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:25.203225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:25.204422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:25.205605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 440/873] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:25.210087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.262268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.297199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6188e80-9255-4619-ad80-6226d4202437 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.321396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5553-798d-4e0e-80ff-7db3021c8620 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.344193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.345328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.345610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.345887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.353550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.354999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.361885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.362729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.363220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.363645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.364552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:25.365006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.366500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c884a0-3866-4d8e-8daf-559ee2164c5a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5c894ea1-a111-414d-b850-2a8261ee4cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:25.368984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:25.370034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:25.371117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 434/874] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:25.371797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b51f-08d0-4aa4-a985-921ab6a36e01 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.372085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b51f-08d0-4aa4-a985-921ab6a36e01 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.372382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063b51f-08d0-4aa4-a985-921ab6a36e01 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.374330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 435/875] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:25.377640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 441/876] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:25.378787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063b51f-08d0-4aa4-a985-921ab6a36e01 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.379634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.379929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.380247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.391972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.398762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:25.399947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:25.472060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 442/877] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:25.472937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.489015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063b51f-08d0-4aa4-a985-921ab6a36e01 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.520356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.528059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.530017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.530017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.530017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.530927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:25.531435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.533120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.550938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 436/878] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:25.552127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.576645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9533a-f533-4526-895e-fec10eb0d11a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.611639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.612352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.612639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.612916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.613623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:25.613930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.615295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.619956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 443/879] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:25.620867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:25.642179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.687503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25d7be-4220-4555-abc4-7c6a8184cb2b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.739840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.740836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.741214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.741568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.742467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.745071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82011c-e2bf-4b3f-a58f-a9e7d16faa4d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.754567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8c518-1006-4ba6-b6b3-db34e45c6bb4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:25.764470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:25.792752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:25.793424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:25.793693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:25.793967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:25.794804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=89c19949d79a43beb88b88662b0388f7) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:25.795122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:25.797110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea58a09-05d1-43c3-81df-dd7f868847a6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:25.803199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 444/880] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:25 2022] GET /identity/v3/role_assignments?user.id=89c19949d79a43beb88b88662b0388f7&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:25.860404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 437/881] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:25 2022] POST /identity/v3/services => generated 269 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:26.901895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca82ee-97b3-42db-be3b-c13f24122efc None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:26.902435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca82ee-97b3-42db-be3b-c13f24122efc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:26.902515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcca82ee-97b3-42db-be3b-c13f24122efc None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:26.904138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 445/882] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:26.911240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:26.911660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:26.911835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:26.929547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:26.930745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:27.008731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 438/883] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:27.031501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca82ee-97b3-42db-be3b-c13f24122efc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.139922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcca82ee-97b3-42db-be3b-c13f24122efc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.175197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:27.176380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.176871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.177350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.178199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:27.179758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:27.191711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:27.192799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:27.193846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:27.196356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 446/884] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:27.205442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.260631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:27.304468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bd3c91-ce61-402f-b0cf-1e5e76c2045a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.341252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:27.341926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.342215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.343041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.343759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:27.344068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:27.345468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:27.350742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 439/885] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:27.356020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.397489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:27.466630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152eb054-3bef-4942-a5e3-30afbe720730 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.501947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:27.502992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.503465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.504009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.504934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:27.505418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:27.506958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:27.512507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 447/886] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:27.519080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.622792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d818d3a-434e-4837-a75b-d65cd0e28eb9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.644654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:27.670959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:27.670959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.670959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.670959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.671354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] RBAC: Adding query filter params (interface=public, service_id=0876e99f5185444a80e4f0a40fadbd0f, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:27.671354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:27.671354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13beb0f-7b3d-4100-ac3d-20a9076fcf9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:27.673485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 440/887] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:27 2022] GET /identity/v3/endpoints?service_id=0876e99f5185444a80e4f0a40fadbd0f&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:27.678806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.721687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5c6e-2024-4d03-960d-8b17b544d6f0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.722036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5c6e-2024-4d03-960d-8b17b544d6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.722283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec5c6e-2024-4d03-960d-8b17b544d6f0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.724877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 441/888] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:27.728865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.729154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.729434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.749085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:27.750282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:27.785573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:27.789939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b6cc3-46dc-4760-8126-89fe3ba18c9b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.826038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 442/889] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:27.828522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:27.829376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.829788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.830723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.831595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:27.833147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d6d679-ff0d-4986-a444-c5ed5b02bebf None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:27.839479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 448/890] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:27 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:03:27.848509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:27.940625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131a8b-7c96-4b82-8c36-e138d798466c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.941584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131a8b-7c96-4b82-8c36-e138d798466c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.942064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed131a8b-7c96-4b82-8c36-e138d798466c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.944109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 449/891] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:27.949495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591e55-66cd-4544-a927-cdda5b558466 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:27.950076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591e55-66cd-4544-a927-cdda5b558466 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:27.950550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35591e55-66cd-4544-a927-cdda5b558466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:27.972848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-35591e55-66cd-4544-a927-cdda5b558466 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:27.973250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0aac9-dab1-476c-af27-7cf70a4c2800 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:27.974056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35591e55-66cd-4544-a927-cdda5b558466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:27.998033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.021810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.022529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.022810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.023086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.024297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.025739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.065838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 450/892] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:28.067037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b39d-8897-430c-b84b-9b3195bbf6e6 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.067311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b39d-8897-430c-b84b-9b3195bbf6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.067592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927b39d-8897-430c-b84b-9b3195bbf6e6 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.072182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 451/893] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:28.074274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.074274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.074598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.091463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:28.092764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:28.099456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 443/894] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:27 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:28.100379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.210537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 452/895] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:28.221472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684177-b765-4c9f-ae80-70d57ec50b62 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.234805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.254390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.264381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.268746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.268746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.268746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.268746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.269258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:28.284129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:28.285104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:28.286125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 444/896] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:28.292587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.349751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.351645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67a680-3bf3-4730-bbc5-fe9b80b84c1a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.396392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.397371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.397660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.398315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.412070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:28.418579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0b4a7-70f1-48cf-ab25-7a629321e488 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:28.423521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:28.424537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:28.425372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 453/897] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:28.432604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.465607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.466324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.466612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.466884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.468263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:28.468572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.469956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.475633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 445/898] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:28.481026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.526064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.549553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b7257-6d7f-473a-bd0e-48668e0db2b5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.585665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.586426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.586634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.586899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.587654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:28.587964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.589478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.603434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 454/899] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:28.604710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.622675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce77bf-ac68-4159-afb1-fe70593b387d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.624403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.658210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.659399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.659887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.660938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.661427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:28.661828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.663499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.673645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 446/900] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:28.674646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.730638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd74a47e-1bd3-4f69-8c73-2e9f62d56020 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.772239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.773845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.774334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.774833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.787693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.791560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.793877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.798050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b13490-bd2e-4f83-a365-6db2e9ed11a2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:28.814616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:28.815630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:28.816761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:28.816761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:28.816761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:28.816761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:28.823433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 455/901] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:28.824109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.850326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:28.850990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:28.851275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:28.851544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:28.852435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] RBAC: Adding query filter params (interface=public, service_id=b839116473b94309b68e720015f394cc, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:28.852747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:28.854305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:28.860164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 447/902] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/endpoints?service_id=b839116473b94309b68e720015f394cc&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:28.865522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:28.899559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:28.978147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383d534-a81a-4d5c-86d5-06978ee654a1 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:28.982395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072656b-dda1-41a2-ab01-1c2ddb662fad None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:29.019145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.019833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.020145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.020425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.021130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.022554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.028405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.029337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.029532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 448/903] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:03:29.030019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.030352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.031096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:29.031403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.044149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.047558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 456/904] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:29.052865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:29.160673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:29.168440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a16b2d-e6fa-4942-891f-45c320e31d06 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:29.204060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.204926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.205207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.205483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.214026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.215473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:29.230342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:29.231313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:29.233009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 449/905] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:29.237293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:29.298053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:29.345845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17976e5e-ccc0-4f07-a03a-97bc5d82eaad None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:29.382325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.383350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.383858 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.384360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.385398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:29.385903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.387645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.405957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 457/906] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:29.413185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:29.516425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496d8df-e6fe-49e9-a054-3c3d99d90808 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:29.552181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.552829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.553200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.553474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.578681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:29.624612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.626067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.730385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 450/907] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:29.737180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:29.850780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57406d92-17e6-4c5b-8c38-495c676b49a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:29.862749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:29.885761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:29.886558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.886838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.887113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.897295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:29.898740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a12043cb-f01b-49b7-9d0c-1d55b4399bde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:29.916609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:29.917707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:29.918831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:29.918831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:29.918831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:29.918831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:29.921638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 458/908] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:29.927724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:29.965757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927246a9-e1c1-4d17-918d-cb7ba42fdb04 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.966089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927246a9-e1c1-4d17-918d-cb7ba42fdb04 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.966300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927246a9-e1c1-4d17-918d-cb7ba42fdb04 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.968384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 459/909] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:29.973131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:29.973425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:29.973703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:29.990853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:29.992034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:29.992616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.035404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a026ca-6a04-44d9-9e0c-c00e70e16eab None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.066801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 460/910] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:30.078380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.078980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.079261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.079536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.080346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.080663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.082050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.091574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.100063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 451/911] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:30.107972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.193455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.202508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce7fde7-da7a-4cf9-acce-e21c9a8f6031 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.218228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac083e-f867-4920-8866-b7587a6310bf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.238174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.240537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.241342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.241628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.241901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.242562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.243928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-985bea33-1186-4ffb-89c3-f9e2f790759b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:30.255855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:30.257162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.258037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 461/912] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:30.258837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae55-b6e8-4ff3-962e-1c680d0d3446 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.258837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae55-b6e8-4ff3-962e-1c680d0d3446 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.258837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21acae55-b6e8-4ff3-962e-1c680d0d3446 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.260247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 462/913] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:30.262805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acae55-b6e8-4ff3-962e-1c680d0d3446 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.268307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.269132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.269417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.269689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.276927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.278370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d450747b-3766-46e4-a256-26962f9230ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:30.294644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:30.295611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:30.296543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 452/914] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:30.297488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.297775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.298054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.314555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:30.315745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:30.374173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21acae55-b6e8-4ff3-962e-1c680d0d3446 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.394202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 453/915] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:30.395058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.418846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.419756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.420047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.420779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.421735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.422066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.424236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.432249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 463/916] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:30.433278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.456109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.505624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc35942-4ee2-4f1a-9eb7-bb2be37b8529 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.509119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.540751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.541405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.541751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.541854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdffcaa-4805-4b77-ac6c-b4a369ed4bad None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.542036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.542809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.543116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.544568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.555801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 454/917] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:30.556627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.583930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.585093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.585578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.586001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.586826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.588628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:30.601272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:30.602452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:30.603477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:30.605647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 464/918] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:30.606564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.668917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87ba8-eb80-4b47-8708-07abd5d164a6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.697054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.705034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.710677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.718667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 455/919] 10.222.0.33 () {56 vars in 1114 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:30.718812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ccb3a6-5c29-4e7b-b622-5618ddb58028 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.718895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.746111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:30.752470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.756320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.756320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.756320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.756320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] RBAC: Adding query filter params (role.id=d038685610764818994a09c07c7a70f3, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=89c19949d79a43beb88b88662b0388f7) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.756320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.756690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.772147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 465/920] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/role_assignments?user.id=89c19949d79a43beb88b88662b0388f7&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=d038685610764818994a09c07c7a70f3 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:30.772147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.851508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906591d0-5288-463e-82a3-55e31af5396f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.892284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.893131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.893513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.893963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.894940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:30.895344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.896996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:30.902821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474543b-e0e3-4291-b549-1dacc869ccc0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:30.907818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 456/921] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:30.908918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:30.953980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:30.954615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:30.954913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:30.955185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:30.955929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:30.957464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.019707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.028914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974a3ba-4e91-4723-adca-619c83632780 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.055565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 466/922] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:31.081002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.082148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.082647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.083133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.084081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:31.084628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.086368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79a6c-d6d3-4b86-9275-bedda767a7e1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.093005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 457/923] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:31.098699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.103577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.159670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe192-85b2-410d-8e86-a1cc5d25e96f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.160028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe192-85b2-410d-8e86-a1cc5d25e96f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.160272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe192-85b2-410d-8e86-a1cc5d25e96f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.162773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 458/924] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:31.170145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.171358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.171746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.190437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:31.191816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:31.224736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18abbc7b-97d8-4e55-a8ea-dd4c385963cb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.268133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.268819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.269111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.269397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.270196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] RBAC: Adding query filter params (interface=public, service_id=562e707867ec41a699c5e2ab21b90ea5, region_id=RegionOne) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:31.270515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.271889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.274049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 459/925] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:31.280173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 467/926] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:31 2022] GET /identity/v3/endpoints?service_id=562e707867ec41a699c5e2ab21b90ea5&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:31.283615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.301423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.368898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.378828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.398022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc54cc2-80be-44b6-b445-e7ad1269e8e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.402997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918f6ee-4fcc-4af4-9737-2e6f8dc5c240 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.435316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.436360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.436887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.437413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.438467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.440476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.440772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.441683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.442072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.442423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.443281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.444682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.448936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 460/927] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:31 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:31.466002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:31.467796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 18:03:31.468775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:31.471680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 468/928] 10.222.0.33 () {56 vars in 1132 bytes} [Tue Jul 12 18:03:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:31.477714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.591194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a86ab0-1bf7-4e56-b5ea-d1fe7627c6f2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.630431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.631101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.631385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.631659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.632399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:31.632710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.634190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.639937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 461/929] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:31.645802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.749942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665a710-cc14-4e75-9cdb-a97b7debb08f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.779297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.784304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.784975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.785262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.785541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.786256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:31.786556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.787932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d21e3-801d-4c3e-a25e-bd9f986ce847 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:31.793471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 469/930] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:31.799544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:31.817559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:31.911588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030574c2-ca68-4816-9186-e01e80d6a343 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:31.948756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:31.949415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:31.949698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:31.949972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:31.950707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:31.952106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119dbd0a-9b27-4d4c-ab67-413a39c9b149 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:32.059605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 462/931] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:32.837351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940fbed-f152-4006-bf85-65cdd3e36281 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:32.837830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940fbed-f152-4006-bf85-65cdd3e36281 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:32.837908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940fbed-f152-4006-bf85-65cdd3e36281 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:32.839498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 470/932] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:32.844861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:32.845156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:32.845442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:32.862260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:32.863442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:32.924268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:32.938100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 463/933] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:32.960780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940fbed-f152-4006-bf85-65cdd3e36281 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.066186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940fbed-f152-4006-bf85-65cdd3e36281 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.099551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.100321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.100613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.100887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.111659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d06f9f37-2e00-43d4-86cc-3d233bbec040 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:33.119870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:33.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:33.121650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 471/934] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:33.128617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.175019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b17b-4723-443c-bf49-800badb4db91 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.175358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b17b-4723-443c-bf49-800badb4db91 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.175586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6b17b-4723-443c-bf49-800badb4db91 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.177234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 472/935] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:33.187150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.187448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.187726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.207983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:33.210096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:33.241281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18cbcb-bfb4-45b3-a134-d830d27d0179 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.278211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:33.287650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.291422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.291422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.291422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.291422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:33.292143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.293818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.303798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 473/937] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:33.304101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 464/937] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:33.312605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.329130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.397353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:33.422804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091d028-8947-43c6-b5e4-65985644b861 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.462589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.463765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.464293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.464800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.471004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1a921-5338-4933-b16e-b9c93e897a18 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.476720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.478420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:33.498026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:33.498929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:33.499837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:33.499837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:33.499837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:33.499837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:33.506439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 474/938] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:33.507530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.513152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.513857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.514181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.514462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.515179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.516653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.518547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING keystone.server.flask.common [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 18:03:33.551985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:33.566677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:03:33.566677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:03:33.566677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [parameters: {'id': '2f4c468af6bc44e98ed3569460c141a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:03:33.566677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f4c468af6bc44e98ed3569460c141a7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f4c468af6bc44e98ed3569460c141a7. Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:03:33.577379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 18:03:33.578745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 12 18:03:33.579929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:03:33.581007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:03:33.581927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:03:33.583438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': '2f4c468af6bc44e98ed3569460c141a7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.585098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:33.586545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f4c468af6bc44e98ed3569460c141a7. Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.588273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 465/939] 10.222.0.33 () {60 vars in 1140 bytes} [Tue Jul 12 18:03:33 2022] POST /identity/v3/projects => generated 262 bytes in 253 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:33.590372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.629098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953d207-22dd-4e70-81e9-e63227e7bb55 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.664009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.664648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.665048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.665585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.666439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:33.666741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.668140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b284bf-6e39-4fdb-a801-ef7195b931aa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.684146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 475/940] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:33.684146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dec12-be86-4ca8-a313-d236c606f5c8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.684146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dec12-be86-4ca8-a313-d236c606f5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.684146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838dec12-be86-4ca8-a313-d236c606f5c8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.684146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 476/941] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:33.686756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dec12-be86-4ca8-a313-d236c606f5c8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.712039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bd0cd-87a5-4e9f-a064-efb436baea85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.724270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:33.755052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.756235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.756500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.756779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.765518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.767221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a684bc60-d53f-446f-a31a-a9b4a2c66eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:33.783870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:33.785025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:33.786141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:33.790035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 466/942] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:33.791487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.791771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.792046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.793949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:33.799568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838dec12-be86-4ca8-a313-d236c606f5c8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:33.809985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:33.811553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:33.846167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:33.847562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:33.847997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:33.848441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:33.855855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:33.857502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:33.872995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:33.874119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:33.875230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:33.877199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 477/943] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:33.878203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.891573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 467/944] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:33.894629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:33.995375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3269f0-5f09-47ab-a379-2209c391c464 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.002460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.006763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dfff08-f3e5-4699-b465-ddbf601eb13d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.031111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.031871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.032254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.032600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.033428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.033800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.035288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.043344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.044106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.044489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.044834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.045790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.046689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.048222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.053184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 478/945] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.053184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.074214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.087072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 468/946] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.093425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.193637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3515ea8-a888-42df-a260-e1d2c9772b31 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.219623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad413d5-c87a-4e99-9561-0d896b96dcca None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.232574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.233566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.233951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.234392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.235065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.236553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d74b1ca1-c668-482b-8404-da5b84605292 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:34.249545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:34.250742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:34.251731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.252709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 479/947] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:34.254085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95101-0d57-41f5-9665-5e79776443e2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.254210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95101-0d57-41f5-9665-5e79776443e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.254389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c95101-0d57-41f5-9665-5e79776443e2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.256187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 480/948] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:34.258715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c95101-0d57-41f5-9665-5e79776443e2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.272824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.273630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.273914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.274188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.287772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.289977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b3faab0e-eb0b-44cd-9a77-5a0b60a93567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:34.308463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:34.309409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 469/949] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.311771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.312202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.328778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:34.329955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:34.333957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.360238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.381586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c95101-0d57-41f5-9665-5e79776443e2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.412490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 470/950] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:34.412490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.426248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.426935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.427236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.427498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.428721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.428857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.430616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.436329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 481/951] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.437025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.527297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430546a4-ccfa-4bea-b2fb-b643d65e1d3b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.539582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2b551-c1e1-4cf9-b38b-94acf014f8ee None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.566549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.567212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.567498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.567767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.568523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.568826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.570191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.577220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.578153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.578714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.578974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.579677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] PATH_INFO: `/v3/services/compute` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.579931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.581691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.587744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 471/952] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.587744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:34.598512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:34.599861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:34.601025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.607150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 482/953] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:34.607150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.622222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.705369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bb222-3179-47c5-96f9-0d5435c3bad1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.715669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdecdbcf-26e2-45be-9767-bbd555ef91fd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.740641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.741306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.741591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.741863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.742574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.742883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.744276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.755334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 472/954] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.755334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.757681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.758555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.758904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.759250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.766909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.768467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:34.784077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:34.785145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 483/955] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:34.791143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.830114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.867292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff23abcf-1c1a-460c-9c95-7711912aece6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.873799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:34.900420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.901089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.901377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.901655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.902363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:34.902671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.904068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:34.904317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0ff8f-3d5d-4e67-8c69-39d030f4b9fc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:34.913928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 473/956] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:34.913928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:34.942067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:34.942852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:34.943285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:34.943575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:34.944339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:34.945706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:35.020156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 484/957] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:35.020156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:35.020454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e73296-e7c7-4bdc-96aa-b8061d10ebe4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:35.054029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:35.070663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:35.073621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:35.073621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:35.073621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:35.073621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:35.073621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:35.075310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:35.091243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 474/958] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:35.097054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:35.140399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e77d02-ea69-4ac4-bab9-86a683263fdc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:35.171213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:35.181973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:35.183849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:35.183849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:35.183849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:35.184972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:35.185353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:35.187427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b8984-465a-4e27-ac83-67c33ca4d4a4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:35.192819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 485/959] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:35 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:35.233985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b56387-f3d0-4be1-a2e1-aad179d58f41 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:35.278573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:35.279574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:35.279866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:35.280176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/89c19949d79a43beb88b88662b0388f7/roles/d038685610764818994a09c07c7a70f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:35.282592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=89c19949d79a43beb88b88662b0388f7, role_id=d038685610764818994a09c07c7a70f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:35.284090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cadfe4-0747-4094-96f3-f00e73cbbdae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:35.350812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 475/960] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:35 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/89c19949d79a43beb88b88662b0388f7/roles/d038685610764818994a09c07c7a70f3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:03:36.144304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e88e-252a-402e-92a6-a4993b2b4a66 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:36.144798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e88e-252a-402e-92a6-a4993b2b4a66 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:36.144798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8e88e-252a-402e-92a6-a4993b2b4a66 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:36.146412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 486/961] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:36.151770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:36.152065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:36.152372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:36.170368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:36.171560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:36.214196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:36.243398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 476/962] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:36.269907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8e88e-252a-402e-92a6-a4993b2b4a66 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:36.378152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8e88e-252a-402e-92a6-a4993b2b4a66 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:36.414421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:36.415019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:36.415564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:36.415842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:36.416584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:36.418013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:36.419327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING keystone.server.flask.common [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 18:03:36.463304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.sql.core [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:03:36.463304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:03:36.463304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [parameters: {'user_id': 'ccf4398ac29d4e1cace3ef08f48da95e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:03:36.463304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80582) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 12 18:03:36.479538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:03:36.481599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application yield resource Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application next(self.gen) Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise self.value Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application session.commit() Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 18:03:36.483302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.session.flush() Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application compat.raise_( Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 18:03:36.484894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 18:03:36.486137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application conn.query(q) Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application result.read() Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 18:03:36.487481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ccf4398ac29d4e1cace3ef08f48da95e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:36.494055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 18:03:36.495708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:36.497694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 487/963] 10.222.0.33 () {60 vars in 1131 bytes} [Tue Jul 12 18:03:36 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:36.498738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:36.596945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21664f3e-4910-4c53-8681-319a15a15778 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:36.631165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:36.632034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:36.632406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:36.632687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:36.640367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:36.641809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a255e47e-69eb-401a-bfbd-edfa0a681af5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:36.656004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:36.657992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:36.660271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 477/964] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:36.663202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:36.723536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:36.771325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d84b7c5-af58-4f91-ae0b-0cafb91769be None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:36.806237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:36.806963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:36.807249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:36.807521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:36.808364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:36.808669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:36.810375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afda5f15-5b1c-4db5-ad90-f46e4361dadc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:36.849940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 488/965] 10.222.0.33 () {56 vars in 1101 bytes} [Tue Jul 12 18:03:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:37.197173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6b04-4861-4a6f-a378-3faf790c12e2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.197480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6b04-4861-4a6f-a378-3faf790c12e2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.197754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43d6b04-4861-4a6f-a378-3faf790c12e2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.199261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 478/966] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:37.204443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b96-ba61-49fa-a0de-9b30dd6e6cc3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.204892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b96-ba61-49fa-a0de-9b30dd6e6cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.205058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1b96-ba61-49fa-a0de-9b30dd6e6cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.222517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e47b1b96-ba61-49fa-a0de-9b30dd6e6cc3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:37.224029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e47b1b96-ba61-49fa-a0de-9b30dd6e6cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:37.292467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 489/967] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:37.292926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcf793-550c-43c8-a004-4a3b4521dd1d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.293381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcf793-550c-43c8-a004-4a3b4521dd1d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.293466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abcf793-550c-43c8-a004-4a3b4521dd1d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.294921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 479/968] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:37.300295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.300586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.300862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.315315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcf793-550c-43c8-a004-4a3b4521dd1d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.318669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:37.319972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:37.351291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.359875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.392041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 490/969] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:37.414748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.420734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abcf793-550c-43c8-a004-4a3b4521dd1d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.456966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.457995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.458436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.458869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.459683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:37.461360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fd8202c3-2004-4a94-9a1a-2a1d3f568e53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:37.474788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:37.476078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:37.477217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:37.479596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 480/970] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:37.481121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daccd0-437a-42cf-8be6-10d7488cadf9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.481411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daccd0-437a-42cf-8be6-10d7488cadf9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.481691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09daccd0-437a-42cf-8be6-10d7488cadf9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.483554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 481/971] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:37.485837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daccd0-437a-42cf-8be6-10d7488cadf9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.525168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7e554-0d3a-44a8-9f6b-c69b2fade194 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.559818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.560554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.560871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.561152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.561876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:37.563247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabe8c37-6d98-4771-9a61-ddbcbd15b7fd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:37.581358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.586142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09daccd0-437a-42cf-8be6-10d7488cadf9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.620145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 491/972] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:37 2022] POST /identity/v3/services => generated 242 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:03:37.620145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.620145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.620145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.627228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:37.627465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.627986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.628301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.628578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.628748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:37.629304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:37.629609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:37.631085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:37.637047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 482/973] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:37.643295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.659391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.716252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 492/974] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:37.739830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.758360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42de34f5-805d-4db1-9ee5-35f252c2586e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.803175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.803858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.804191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.804477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.805201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:37.805507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:37.806911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:37.815361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 483/975] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:37.821185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.846457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.867773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022bf645-2ec4-4bc0-8bf5-e79ac0d9e7ca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.909983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.910793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.911366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.911366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.922041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:37.924210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743692d-3eb1-45f1-b0d9-dcc6d1f6c8f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:37.930139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:37.931390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:37.932331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 493/976] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:37.938075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:37.962512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:37.964674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:37.965332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:37.965619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:37.965894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:37.966758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] RBAC: Adding query filter params (interface=admin, service_id=562e707867ec41a699c5e2ab21b90ea5, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:37.967130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:37.968539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:37.978026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 484/977] 10.222.0.33 () {56 vars in 1249 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/endpoints?service_id=562e707867ec41a699c5e2ab21b90ea5&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:37.979059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.052305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d983-7631-4f72-acb5-dd5214501caa None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.070546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:38.087335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd4bd1-0321-4a7f-9e82-ca5e8569d82e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.091279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.092540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.092831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.093114 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.093881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:38.094192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.095598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.105780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 494/978] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:38.111762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.128403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.129148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.129403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.129673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.130377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.131762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.138648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 485/979] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:37 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:03:38.209441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:38.229981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457e5b01-9d49-4023-a1db-23f4894e585f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.266184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.266992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.267273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.267550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.279190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.281211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:38.300052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:38.301292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:38.302593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:38.302593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:38.302593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:38.302593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:38.302593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 495/980] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:38.307136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.408544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5e5d5-ad50-45c0-be69-6029564c641b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.443171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.443833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.444132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.444416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.445136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:38.445442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.446810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.463008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 486/981] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:38.464605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.562719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b157eff-3604-4806-8c9d-494449922436 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.595835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.596673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.596956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.597230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.599135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:38.605772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.607209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:38.621613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:38.622784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:38.623847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 496/982] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:03:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:38.628644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.642151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:38.731205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ba608-6124-451a-b1f9-b81b3d0f18e0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.767179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.768308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.768832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.769316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:38.770391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:38.770916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:38.772655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:38.791681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 487/983] 10.222.0.33 () {56 vars in 1149 bytes} [Tue Jul 12 18:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:38.797122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:38.907207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee388b51-8885-4628-b764-657ea99bc234 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:38.942085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:38.942865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:38.943245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:38.943615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.001899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.009609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.017104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.112594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 497/984] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:38 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:39.114153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.182933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.215145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9700f-8d4c-459b-bf18-c6e384fd6778 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.252446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.253256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.253544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.253822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.264362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.265814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:39.283066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:39.283985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:39.284916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:39.284916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:39.284916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:39.284916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:39.288919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 488/985] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:39.290615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.386128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.392927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38ba9e0-6954-42a0-ac5a-813630f7ee3d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.426964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.427624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.427973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.428285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.429004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:39.429310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.430666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.447008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 498/986] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:39.448909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.560944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d24de-ef39-4830-bf43-da04fdec4363 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.580802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.595574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.596399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.596689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.596969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.603698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.605271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-076c1aa3-4c53-4952-b69f-f7801aa41973 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:39.620041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:39.620990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:39.621905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:39.624438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 489/987] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:39.627157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.698309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27879-9849-447a-b9f1-73b39cecb37f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.698595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27879-9849-447a-b9f1-73b39cecb37f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.698810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff27879-9849-447a-b9f1-73b39cecb37f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.700576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 490/988] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:39.705148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.705444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.705727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.723311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:39.724632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:39.739534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f5983-b622-4bb0-bf61-64c5df03cd14 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.773899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.774567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.774851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.775126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.775923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:39.776268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.777701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.790908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 499/989] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:39.797478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.806664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 491/990] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:39 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:39.819785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.821787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:39.901500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968aeeb-1f64-4517-9dca-07864567cfb9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.928755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649070c-b056-42bc-a4bb-de0eab8fb620 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:39.937400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.938060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.938339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.938615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.939442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] RBAC: Adding query filter params (role.id=d038685610764818994a09c07c7a70f3, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=89c19949d79a43beb88b88662b0388f7) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:39.939751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.940359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:39.941215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.947268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 500/991] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/role_assignments?user.id=89c19949d79a43beb88b88662b0388f7&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=d038685610764818994a09c07c7a70f3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:39.966400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:39.968163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:39.968496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:39.968777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:39.969464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:39.971399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:39.984904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:39.985975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:39.991831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 492/992] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:39.994420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.083340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:40.106901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9a1d7-f50e-4822-9e9a-6dfb7ad4bb4f None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.144059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.144815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.145104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.145380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.146094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:40.146404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.147780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba4fb2d-96ae-42a7-b1c3-686112e68ffd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.153020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 501/993] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:40.159491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.166012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281bd7c-a25a-4800-9278-85fbc2d4a592 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.166300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281bd7c-a25a-4800-9278-85fbc2d4a592 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.166573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281bd7c-a25a-4800-9278-85fbc2d4a592 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.168094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 502/994] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:40.172842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.173135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.173418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.190275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:40.191445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:40.264240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 503/995] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:40.270290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a775a-e9e8-4a5e-9dcf-4fd5842211e6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.286642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.305846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.306511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.306792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.307066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.307760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:40.308069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.309457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.319729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 493/996] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:40.320932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.362667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:40.363708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:40.393885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f6666d-af50-45e3-a1f2-8dd578f0bea8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.427406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.428240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.428531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.428809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.429461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.430831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.431222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a525b06d-2fca-42ba-ba97-d05fd0a952c2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:40.443456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:40.444549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 18:03:40.445410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:40.448507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 504/997] 10.222.0.33 () {56 vars in 1126 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:40.450953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.474069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.474737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.475059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.475339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.476148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] RBAC: Adding query filter params (interface=public, service_id=92dc5cdcd5144db1adf67268a040f0ca, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:40.476467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.477850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.488028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 494/998] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/endpoints?service_id=92dc5cdcd5144db1adf67268a040f0ca&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:40.489305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.564480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f98226-7948-4505-9e9d-6c73b9c41098 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.593820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93143abd-ed8b-4e9d-8672-664678ac30e0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.595345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:40.600436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.601156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.604341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.604341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.604341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:40.604341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.604341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.606607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:40.611124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 505/999] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:40.616647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.630490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.631194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.631483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.631762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.632493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.633873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.640408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 495/1000] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:03:40.731086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e45678-3b59-4415-b157-3adeb927cca0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.767845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.768818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.769272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.769705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.770644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:40.771116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.772751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc776c-599a-42c1-aa9e-6e5b102e8ce3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:40.782956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 506/1001] 10.222.0.33 () {56 vars in 1122 bytes} [Tue Jul 12 18:03:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:40.784735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:40.898761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a6b5a-651a-4014-9cb4-dabb49e0fff1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:40.932497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:40.933154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:40.933435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:40.933706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:40.934446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:40.936494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb9441-6d60-4fce-b971-1e9db1af400c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:41.013034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 496/1002] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:42.029796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14445e9-4c61-404b-8661-add45af8d181 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.030346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14445e9-4c61-404b-8661-add45af8d181 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.030346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14445e9-4c61-404b-8661-add45af8d181 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.031891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 507/1003] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:42.037966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.037966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.037966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.054519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:42.055690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:42.077094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:42.131309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 497/1004] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:42.153491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14445e9-4c61-404b-8661-add45af8d181 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:42.217079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:42.255748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14445e9-4c61-404b-8661-add45af8d181 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:42.289072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:42.289872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.290422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.290700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] PATH_INFO: `/v3/services/image` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.291352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:42.292757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:42.304717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:42.305865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:42.306965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:42.311185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 508/1005] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Jul 12 18:03:42 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:42.312261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:42.408377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e63cfb-205a-4a16-8594-e18358dd0eb9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:42.442300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:42.442967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.443254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.443528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.444275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:42.444581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:42.445962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d6b9d4-1feb-4d08-a0d0-076cd86d4935 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:42.450916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 498/1006] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:42.456733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:42.562961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b18dc-f8d1-4f15-a1fc-3badb83e1810 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:42.595856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:42.604189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:42.604916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.605165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.605424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.606138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:42.606451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:42.608405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82772f69-b667-49e9-96dc-8e0d2ffd3dc7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:42.620448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 509/1007] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:42 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:42.688215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae6eb-0c58-44d8-b37a-cf51a29fd2e3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.688415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae6eb-0c58-44d8-b37a-cf51a29fd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.688705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae6eb-0c58-44d8-b37a-cf51a29fd2e3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.690113 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 499/1008] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:42.695766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.696058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.696399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.713830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:42.715051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:42.789399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 510/1009] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:42.814013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae6eb-0c58-44d8-b37a-cf51a29fd2e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:42.834179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:42.917648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae6eb-0c58-44d8-b37a-cf51a29fd2e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:42.952364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:42.953068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:42.953349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:42.953675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:42.954322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:42.955710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0a4767f1-30e5-47a8-97bc-3185d96e70dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:42.967248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:42.968316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:42.969189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 500/1010] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:42.976386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:43.066385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414cac-15f7-4358-936d-cf2deb5ecf93 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.066913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414cac-15f7-4358-936d-cf2deb5ecf93 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.066913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4414cac-15f7-4358-936d-cf2deb5ecf93 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.068477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 501/1011] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:43.073098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.073390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.073668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.078875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b53a6-88b2-4614-8db0-02ee150cf9fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:43.090765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:43.091953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:43.102793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:43.115028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:43.115720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.115975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.116282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.116989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:43.117296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:43.118686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:43.128538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 511/1012] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:43.129578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:43.168972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 502/1013] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:43.192700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:43.205283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:43.234013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d6a21-ab8e-4b1f-9648-b695d6a1f3f9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:43.272408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:43.273282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.273396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.273623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.274333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:43.274640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:43.276100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:43.282203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 512/1014] 10.222.0.33 () {56 vars in 1112 bytes} [Tue Jul 12 18:03:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:43.287818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:43.297675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70f36e-a226-4ef8-bf42-588dbc549c8b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:43.336781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:43.337574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.337851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.338121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.339278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:43.340759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:43.348072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 503/1015] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:43.349072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:43.350155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:43.399656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbff9c-592b-45f0-a618-a372b99e6d9b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:43.433228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:43.437423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:43.438245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.438534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.438817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.439561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:43.441072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0c5a50-b29b-47fc-bdc4-5379da9d2ef2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:43.454615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a167156-3cc8-46c4-814f-1741fdc0b057 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:43.489112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:43.489706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:43.489994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:43.490270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:43.491017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:43.492534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998a528-b10b-4324-a7f7-2480a8f60426 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:43.527803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 513/1016] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:03:43.576433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 504/1017] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:43 2022] POST /identity/v3/projects => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:03:44.646964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bda04-172f-4a36-8943-4d2e2285a71d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:44.647478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bda04-172f-4a36-8943-4d2e2285a71d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:44.647581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97bda04-172f-4a36-8943-4d2e2285a71d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:44.649061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 514/1018] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:44.653999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f899-4dc9-421e-9bf9-4fb0d2ee387a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:44.654396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f899-4dc9-421e-9bf9-4fb0d2ee387a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:44.654576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3f899-4dc9-421e-9bf9-4fb0d2ee387a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:44.671901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-64d3f899-4dc9-421e-9bf9-4fb0d2ee387a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:44.673121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64d3f899-4dc9-421e-9bf9-4fb0d2ee387a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:44.749465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 505/1019] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:44.772029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bda04-172f-4a36-8943-4d2e2285a71d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:44.875317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97bda04-172f-4a36-8943-4d2e2285a71d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:44.882945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:44.908895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:44.909489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:44.909774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:44.910048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:44.910765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:44.912139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1180a924-0ad2-4cde-ae7a-3df2bffd17ae None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:45.018481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 515/1020] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:03:44 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:45.627656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23951-233e-4c0c-b625-08fd1abc2ee0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.628017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23951-233e-4c0c-b625-08fd1abc2ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.628247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc23951-233e-4c0c-b625-08fd1abc2ee0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.629685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 506/1021] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:45.634796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.635089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.635359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.652394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:45.653569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:45.687794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f332-eeff-45da-8719-394b9ecf4305 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.688343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f332-eeff-45da-8719-394b9ecf4305 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.688459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7f332-eeff-45da-8719-394b9ecf4305 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.689871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 507/1022] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:45.694645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.694932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.695208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.712683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:45.713857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:45.731793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 516/1023] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:45.755924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:45.766273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:45.784355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 508/1024] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:45.808330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:45.858621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:45.866801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5008f7-0ca1-4eea-9c4b-1865843f1f4c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:45.903584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:45.904486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.904889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.905165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.906346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:45.908185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:45.909961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 517/1025] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:45.912773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b03c2-0b82-41c5-9cb9-5da166a8b458 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:45.915502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:45.950097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:45.950940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:45.951223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:45.951499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:45.961909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:45.970085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:45.971007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:45.971865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 509/1026] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:45.977296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.026956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:46.028688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a938a1-ec1e-4cf1-9281-d3fc377a2cba None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.063412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.064082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.064391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.064666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.065375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.066800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.086240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683e910b-c157-481e-9cde-444661ffdcf1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.121994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.122766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.123559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.123839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.124641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:46.124984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.126478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.135250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 510/1027] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:46.140882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.166890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 518/1028] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:03:45 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:03:46.255972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad6d46-640a-468f-b632-390260610cd1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.265670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:46.292308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.293124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.293411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.293687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.306782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.308280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:46.326569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:46.327515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:46.328462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:46.328462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:46.328462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:46.328462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:46.328462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 511/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:46.333677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.353331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:46.439874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41aae-58f4-4367-b866-b287cb21abe6 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.473733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.474639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.475072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.475523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.476427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:46.476884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.478390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.491466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 519/1030] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:46.496977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.601235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f75d6-b17d-44f0-b5e7-67e60732dbc5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.634231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.635207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.635597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.635974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.644556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.646121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:46.660296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:46.661361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:46.662342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:46.664195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 512/1031] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:46.667847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.747752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:46.769830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d8e132-741a-4ed9-8ae1-973dc0e62825 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.803323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.803992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.804303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.804579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:46.805410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:46.805716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:46.807131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc0249d-212a-44de-bae1-30384f6d8774 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:46.834821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 520/1032] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:46.836471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:46.859957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:46.940329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd29c6-83a7-426d-9f0e-3cdae4fd8ec4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:46.974561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:46.975206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:46.975488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:46.975761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.040791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6276-d428-4e71-ad12-d2c192000dc3 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.040983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6276-d428-4e71-ad12-d2c192000dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.041264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb6276-d428-4e71-ad12-d2c192000dc3 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.042326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.042806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 521/1033] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:47.043831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.047949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.048276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.048559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.064833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.064996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:47.066037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:47.140279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 522/1034] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:47.148160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 513/1035] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:46 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:47.151117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.155812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.212636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.249643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905c435-7096-4658-a82b-4226700f0fb4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.256715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bf35-df7b-4ce9-8525-f1ecb1f1d0da None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.277507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.285115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.288749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.288749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.288749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.293544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.295240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.295526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.295801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.296481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.298249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.299120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.300751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:47.310104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:47.311098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:47.311950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:47.313988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 514/1036] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:47.319633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:47.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:47.326851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:47.326851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:47.326851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:47.326851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:47.327080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.327165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 523/1037] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:47.327165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.432172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc983202-28ce-4d38-a94b-b496c4cbe1a5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.433659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967de87-b883-4ad5-8c91-6905d2e39db0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.449482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.468058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.468749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.469037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.469314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.469628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.470040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.470294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.470403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.470572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.470849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.471554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.471708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.471869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.473265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.478552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 515/1038] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:47.483856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.485525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 524/1039] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:47.490776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.537541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.592590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cf11f7-378a-4c7b-8a4d-39a40dfff383 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.594557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa5ac14-313c-45e5-a6a2-9352a90bb087 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.627550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.627734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.628548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.628836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.629118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.629224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.629697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.630158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.631169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] RBAC: Adding query filter params (type=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.631773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.633349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.635671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.637129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.639971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 516/1040] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:47.645232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:47.657074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:47.658104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:47.659002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 525/1041] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:47.664090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.701758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.755572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f258b2f-1d01-4668-8e15-fccbd723f36d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.770794 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e3ec6-b132-412a-b03e-9d85ea93c928 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.770970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.793151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.793902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.794199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.794564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.795370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] RBAC: Adding query filter params (interface=public, service_id=072a22ef72af4eaabc058b9972663a54, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.795687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.797092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.803529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 517/1042] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/endpoints?service_id=072a22ef72af4eaabc058b9972663a54&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:47.809335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.813104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.813761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.814048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.814326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.815792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.815792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.816879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.829741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 526/1043] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:47.835584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:47.923085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231c98e4-67a9-471e-99d1-22ddcf4abbfc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.937240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:47.943343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d55138-c00a-4de2-b029-af17b4bc8b5c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:47.965410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.966186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.966502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.966779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.967476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.968856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a54f7f-14ae-41f4-8584-4b2319e610df None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.975736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 518/1044] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:03:47.979391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:47.980068 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:47.980392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:47.980675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:47.981531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] RBAC: Adding query filter params (role.id=d038685610764818994a09c07c7a70f3, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:47.981848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:47.983362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b98db-e35a-454e-b407-5088f4045601 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:47.990044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 527/1045] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:47 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=d038685610764818994a09c07c7a70f3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:48.259682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d18f0-d9cf-43d5-b8f5-f5796282b465 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.259978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d18f0-d9cf-43d5-b8f5-f5796282b465 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.260270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d18f0-d9cf-43d5-b8f5-f5796282b465 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:48.261684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 519/1046] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:48.267313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.267606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.267877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:48.284864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:48.286043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:48.354766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 528/1047] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:48.377344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d18f0-d9cf-43d5-b8f5-f5796282b465 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:48.421896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:48.483791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d18f0-d9cf-43d5-b8f5-f5796282b465 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:48.517776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:48.518548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.518833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.519101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:48.529576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:48.537065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:48.538002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:48.538856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:48.546654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 520/1048] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:48.546816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:48.635714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:48.645580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f38b62-80b1-43c2-ae46-929912a1e8cb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:48.678989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:48.679668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.679949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.680249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:48.681000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:48.681305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:48.682675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:48.695886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 529/1049] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:48.697112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:48.793199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:48.797219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8312771-1382-412d-a03c-823e96072ab9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:48.836372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:48.837231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.837509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.837779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] PATH_INFO: `/v3/users/96799d4f283f416c80ec19f5676988d8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:48.851240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] RBAC: Authorizing `identity:get_user(user_id=96799d4f283f416c80ec19f5676988d8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:48.852772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:48.854695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 521/1050] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:03:48 2022] GET /identity/v3/users/96799d4f283f416c80ec19f5676988d8 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:48.860280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:48.962926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65b805-dd8d-4e73-b539-7995f91de937 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:48.996059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:48.996738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:48.997022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:48.997296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:49.019421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:49.069432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:49.070880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:49.178335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 530/1051] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:48 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:49.179802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:49.278920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e1bda-128f-4a28-a27a-d43c1f65f206 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:49.311783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:49.312662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:49.313048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:49.313324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:49.314477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:49.315902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d7d3cf-d834-47ca-a321-ef5fb644ec09 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:49.317625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 522/1052] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:03:49 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:49.323655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:49.376288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:49.420934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4bcb1-ac12-4be5-97cf-60982247b141 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:49.454308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:49.454959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:49.455241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:49.455513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:49.456366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b, user.id=96799d4f283f416c80ec19f5676988d8) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:49.456676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:49.458105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeccc29-249d-446d-bfe5-8c6c85a9a73c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:49.472217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 531/1053] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:49 2022] GET /identity/v3/role_assignments?user.id=96799d4f283f416c80ec19f5676988d8&scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:50.032664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1eb38-1f1e-4200-93f7-8ffc41896977 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.033057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1eb38-1f1e-4200-93f7-8ffc41896977 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.033221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1eb38-1f1e-4200-93f7-8ffc41896977 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.034789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 523/1054] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:50.040408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559066-53e4-4e71-ba15-868935a31f9a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.040842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559066-53e4-4e71-ba15-868935a31f9a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.041009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2559066-53e4-4e71-ba15-868935a31f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.058524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2559066-53e4-4e71-ba15-868935a31f9a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:50.060300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2559066-53e4-4e71-ba15-868935a31f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:50.126362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ecd7-b475-4f01-9f4f-2d6f6f19c323 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.126552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ecd7-b475-4f01-9f4f-2d6f6f19c323 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.126829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07ecd7-b475-4f01-9f4f-2d6f6f19c323 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.129161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 532/1055] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:50.129426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 524/1056] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:50.134016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.134016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.134216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.149405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ecd7-b475-4f01-9f4f-2d6f6f19c323 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.151091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:50.152321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:50.181451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.205462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.229600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 533/1057] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:50 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:50.252739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.274919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07ecd7-b475-4f01-9f4f-2d6f6f19c323 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.312920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.314006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.314285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.314556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.325231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:50.333727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:50.334642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:50.335485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 525/1058] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:50.340805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.357426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df437445-fcf7-4d2a-b73b-e3396c4313cb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.394459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.395339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.395632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.395915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] PATH_INFO: `/v3/services/image` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.396626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.398001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:50.410194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:50.411179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:50.412030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 534/1059] 10.222.0.33 () {56 vars in 1105 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:50.417640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.430233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.445101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7c142-85b0-4838-8036-57899fa77c06 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.464252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.480212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.480894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.481166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.481439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.482353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:50.482667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.484039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.495003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 526/1060] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:50.498206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.532870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2f9a18-5493-4b07-99a5-6d39485a3d1c None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.572545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.573725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.574241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.574766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.576710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] RBAC: Adding query filter params (name=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:50.577278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.579903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.591067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 535/1061] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:50.592814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.604705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70fcec-722c-45cd-9632-6216e9fcbfbc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.638730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.639517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.639795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.640069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.651335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.652757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.660889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:50.671403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:50.673671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:50.674783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:50.674783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:50.674783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:50.674783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:50.674783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 527/1062] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:50.678265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.713357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3207894-d763-4945-b860-9ad322d3d490 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.717876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.755861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.756555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.757163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.757163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.757859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] RBAC: Adding query filter params (type=image) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:50.758169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.759526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.769713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 536/1063] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:50.770647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.785315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33045-a4da-490e-8d03-2486f0927b7c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.826798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.827469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.827757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.828025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.828791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:50.829096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.830465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.842903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 528/1064] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:50.848970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:50.889030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54162579-ed17-4788-9c29-d9aa719cda3a None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.909990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:50.927010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.927971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.928484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.928952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.929878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.931566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:50.951339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03552f6-1b80-4c82-ae02-0b1ba73c3819 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:50.985301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:50.986088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:50.986370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:50.986644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:50.993676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:50.995104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:51.009257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:51.015749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:51.016826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 529/1065] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:51.018620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.024363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 537/1066] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:03:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:03:51.132065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47cc55-d000-4075-8975-6460353abc8f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.154857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.177700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.178296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.178578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.178855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.179688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:51.179995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.181535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.199271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 530/1067] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:51.206078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.233612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.312465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a11e7-8f89-413a-b2e0-55457f6f9d89 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.347375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.348203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.348498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.348779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.359539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.361018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-64dc40f9-49ef-45b9-8e50-09c89392acfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:51.378063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:51.379022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:51.379949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:51.379949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:51.379949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:51.379949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:51.383866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 538/1068] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:51.385308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.465393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d620a-71e3-4ab8-9fd0-f6e8a08d114b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.465722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d620a-71e3-4ab8-9fd0-f6e8a08d114b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.466012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d620a-71e3-4ab8-9fd0-f6e8a08d114b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.467402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 539/1069] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:51.472377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.472667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.472948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.488338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3058f4-d0d0-471b-baf0-4ec92e9c1b4e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.489735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:51.490916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:51.525923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.526594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.526882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.527166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.527898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:51.528240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.529675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.542181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 531/1070] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:51.547652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.563251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 540/1071] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:51.585902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.588034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.596800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.656514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dc2681-bcc7-4fc5-b739-32cb09f25bf8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.692464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.693281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.693567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.693844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.694018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb3959-1d06-4ca5-8cd9-34c9d5fd7873 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.701683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.703129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:51.717544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:51.718408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:51.719340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 532/1072] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:51.724446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.731149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.731994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.732376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.732646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.742975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:51.751012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:51.751933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:51.752801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:51.757220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 541/1073] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:51.757960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.826524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.832477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:51.834504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71713fde-9e03-43e5-9690-678e78ffa6d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.867475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6739bd-a59d-40ed-91f6-0343d926f458 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:51.869750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.870406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.870688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.870963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.871740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:51.872044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.874164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.885667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 533/1074] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:51.891299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:51.902303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:51.902974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:51.903260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:51.903539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:51.908402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:51.908717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:51.910095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:51.924103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 542/1075] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:51.925191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:52.002491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd43809-c1c9-494a-8f92-eb926eeca873 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:52.027751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93148830-894c-4f62-99f1-fccdccc7b11d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:52.038315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:52.039197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:52.039476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:52.039859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/d038685610764818994a09c07c7a70f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:52.043128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=50043e6bb2414d7dbf9feecd1b1980bd, role_id=d038685610764818994a09c07c7a70f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:52.045575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:52.054727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:52.063109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:52.064036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:52.064358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:52.074420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] PATH_INFO: `/v3/users/96799d4f283f416c80ec19f5676988d8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:52.074420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] RBAC: Authorizing `identity:get_user(user_id=96799d4f283f416c80ec19f5676988d8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:52.074420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:52.074420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 543/1076] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:03:51 2022] GET /identity/v3/users/96799d4f283f416c80ec19f5676988d8 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:52.074420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:52.132937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 534/1077] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:51 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/50043e6bb2414d7dbf9feecd1b1980bd/roles/d038685610764818994a09c07c7a70f3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:03:52.177471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423bf77-7c95-4817-973e-0d25191fbf1b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:52.213461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:52.214353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:52.214639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:52.214911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:52.216817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:52.218275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c44ae1-2487-4ceb-8a35-cf6fb3438bce None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:52.220268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 544/1078] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:03:52 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:52.225999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:52.243612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:52.331559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7dc317-ddfb-45f1-a770-9ae3dd7c21fb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:52.365857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:52.366864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:52.367241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:52.367629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b/users/96799d4f283f416c80ec19f5676988d8/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:52.369684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ccd49adb13b467c8dab7ee9cabe384b, user_id=96799d4f283f416c80ec19f5676988d8, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:52.371200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15c80e-f5ee-40e3-93a8-6bc748309694 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:52.470938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 535/1079] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:03:52 2022] PUT /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b/users/96799d4f283f416c80ec19f5676988d8/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:03:53.076933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105cf-5a76-4907-a1f3-d280cbe6b452 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:53.077271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105cf-5a76-4907-a1f3-d280cbe6b452 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:53.077446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab105cf-5a76-4907-a1f3-d280cbe6b452 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:53.078947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 545/1080] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:53.083826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:53.084145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:53.084429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:53.100867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:53.102039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:53.168428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 536/1081] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:53.190597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab105cf-5a76-4907-a1f3-d280cbe6b452 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:53.257835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:53.297522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab105cf-5a76-4907-a1f3-d280cbe6b452 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:53.336424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:53.336998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:53.337287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:53.337563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:53.403006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:53.404488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:53.462779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:53.506653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 546/1082] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:03:53.508098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:53.511234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:53.609349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15079f41-5405-4d9f-bd49-be6a12ebee82 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:53.643808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:53.644639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:53.644923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:53.645201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:53.656243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:53.657708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2f045784-3333-48a2-bf0b-e3cd1c6fe3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:53.676748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:53.677674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:53.678580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:53.678580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:53.678580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:53.678580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:53.680200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 537/1083] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:53.683996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:53.784596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b7af4-5b8d-4e4e-a2f7-240366c7ada9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:53.821793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:53.822468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:53.822749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:53.823023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:53.823741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:53.824044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:53.825504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a01c-de2e-4312-befe-bbb110104f10 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:53.844160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 547/1084] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:54.186265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6900-cec1-42b5-a335-25f024b23f56 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.186548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6900-cec1-42b5-a335-25f024b23f56 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.186823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e6900-cec1-42b5-a335-25f024b23f56 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.188222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 538/1085] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:54.193360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.193653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.193931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.210717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:54.211877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:54.229080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:54.276023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 548/1086] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:54.299758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e6900-cec1-42b5-a335-25f024b23f56 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.354956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:54.399209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e6900-cec1-42b5-a335-25f024b23f56 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.431910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:54.432739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.433020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.433291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.443526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-297a72b8-58ab-4e7b-aef0-7a1a4cf430ba None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:54.451979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:54.452992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:54.454023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 539/1087] 10.222.0.33 () {56 vars in 1120 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:54.459115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.555067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256390a-1187-46a9-98a1-3fb5f3b1a99b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.588029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:54.588728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.589011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.589284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.590022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:54.590387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:54.591725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:54.592301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582ab5-c9e3-42a2-a2c9-208074ec0b2f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.592750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582ab5-c9e3-42a2-a2c9-208074ec0b2f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.592856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b582ab5-c9e3-42a2-a2c9-208074ec0b2f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.594228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 540/1088] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:03:54.598938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.599229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.599505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.608168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 549/1089] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:54.609579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.616061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:54.617282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:54.628200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:54.685961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 541/1090] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:03:54.708612 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dbcc3a-b817-432f-8d62-c7ad5edba85d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.709920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.740869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:54.741658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.741945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.742226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.753179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:54.754617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:54.755145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:54.772135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:54.773248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:54.774209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:54.774209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:54.774209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:54.774209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:54.774209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 550/1091] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:54.778984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.809527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff024f4-c995-4e1f-8d81-b8defae1748d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.846430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:54.847222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.847507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.847784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.848193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:54.858727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:03:54.866403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:54.867363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:54.868233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 542/1092] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:54.874370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.883254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed32b2-760b-4aae-b9c4-a6b0b58769e7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.916271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:54.916935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:54.917224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:54.917553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:54.918230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:54.918542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:54.920431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:54.931869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 551/1093] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:54.937988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:54.972856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef24c6-5fd2-4eaa-8c61-8d89508401f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:54.979399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.006770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.007430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.007710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.007984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.008754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:55.009057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.010423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.018297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 543/1094] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:55.023964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.035114 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e5c4a-c98c-4e34-9336-1fb5313bebe9 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.061862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.069910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.070697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.075759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.075759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.078404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.079937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:03:55.094392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:55.095491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:55.096498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 552/1095] 10.222.0.33 () {56 vars in 1093 bytes} [Tue Jul 12 18:03:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:55.101480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.122072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec936bfb-ae2e-447d-9192-46379878b5e0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.155281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.156168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.156457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.156738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] PATH_INFO: `/v3/users/96799d4f283f416c80ec19f5676988d8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.157932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] RBAC: Authorizing `identity:get_user(user_id=96799d4f283f416c80ec19f5676988d8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.159370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.161045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 544/1096] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/users/96799d4f283f416c80ec19f5676988d8 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:55.166890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.198798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a33428-02c9-4b4d-bb69-9a31f5cba4dc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.201315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.232955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.233554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.233838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.234117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.234951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:55.235288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.236751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.253551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 553/1097] 10.222.0.33 () {56 vars in 1133 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:55.258990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.264881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915bd9d1-afdc-47c4-a9f0-0c8598dcdd17 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.298445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.299080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.299368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.299636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.304054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.354762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09549641-ba25-426e-a520-9355beeffd9d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.364817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.366265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.388189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.388861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.389144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.389420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.399450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.455941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.457414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.467527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 545/1098] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:03:55.468582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.502595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.554996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 554/1099] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 18:03:55.559722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.565364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd2287-2dd1-479d-ae44-9cbca82123ef None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.599482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.600367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.600655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.600932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.602114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.603556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.610491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 546/1100] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:55.611513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.614923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.657663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452649-fb16-4815-956b-a815ad17ea91 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.691547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.692365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.692652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.692926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.703205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.704679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.711210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:55.711326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69d52-f032-440b-9fc4-ab0ae7094693 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:03:55.722951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:55.725386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:55.726304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:03:55.726304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:03:55.726304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:03:55.726304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:03:55.726304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 555/1101] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:03:55.729718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:55.746066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.746715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.746996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.747323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.748185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b, user.id=96799d4f283f416c80ec19f5676988d8) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:55.748480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.749857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.768276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 547/1102] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/role_assignments?user.id=96799d4f283f416c80ec19f5676988d8&scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:55.840421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b80509-df6d-4796-935f-75c5b25ef2cb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:55.876687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:55.877366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:55.877660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:55.878048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:55.878793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:55.879186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:55.880611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:55.893055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 556/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:03:55.898698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:56.014094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:56.047427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524be3d3-b73e-4c12-84da-805c5be19017 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:56.080267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:56.081058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:56.081343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:56.081616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:56.088322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:56.089769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:03:56.103787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:03:56.104840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:03:56.105780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 548/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:03:56.111365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:56.170001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:56.211360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74960ff5-e1f0-477d-82db-c77ba80fc28b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:56.248098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:56.249009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:56.249299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:56.249577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:56.250368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:56.250681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:56.252132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc341371-c433-4d5e-819d-ee93bf76ee15 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:56.264019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 557/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:56.269959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:56.366741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba7f50-dc8f-438f-82bc-8946c1a8316f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:56.391730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:56.399254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:56.399901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:56.400214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:56.400493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:56.401325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] RBAC: Adding query filter params (role.id=d038685610764818994a09c07c7a70f3, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=50043e6bb2414d7dbf9feecd1b1980bd) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:03:56.401636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:56.403060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231af38-8bc0-4f1a-9e38-3bc408d3c0ff None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:56.409479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 549/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:03:56 2022] GET /identity/v3/role_assignments?user.id=50043e6bb2414d7dbf9feecd1b1980bd&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=d038685610764818994a09c07c7a70f3 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:57.811408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21c0ee-103d-4885-829c-3ff76eeaed5a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:57.811931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21c0ee-103d-4885-829c-3ff76eeaed5a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:57.812026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd21c0ee-103d-4885-829c-3ff76eeaed5a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:57.813392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 558/1107] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:03:57.818657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:57.819085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:57.819210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:57.836493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:03:57.837710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:03:57.900201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 550/1108] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:03:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:03:57.925923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21c0ee-103d-4885-829c-3ff76eeaed5a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:58.022897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd21c0ee-103d-4885-829c-3ff76eeaed5a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:58.040216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:58.056247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:58.057026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:58.057309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:58.057584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:58.058743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:58.060196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b09be-d350-46ad-a4c5-76bdc0f4249d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:58.061894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 559/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:03:58.067323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:03:58.161778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adff48-5a20-4bb3-a311-ff417c396232 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:03:58.183637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:03:58.194915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:03:58.195583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:03:58.195869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:03:58.196243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:03:58.196959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:03:58.198387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc54f2-da1b-403b-aa87-c5950a153ca7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:03:58.285048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 551/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:03:58 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:04:00.315643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a481a2-ad8e-4207-8d20-e823363ced91 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:00.316182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a481a2-ad8e-4207-8d20-e823363ced91 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:00.316280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a481a2-ad8e-4207-8d20-e823363ced91 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:00.317609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 560/1111] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:00.322621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:00.323054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:00.323183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:00.339453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:00.340660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:00.404642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 552/1112] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:00.428378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a481a2-ad8e-4207-8d20-e823363ced91 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:00.525730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a481a2-ad8e-4207-8d20-e823363ced91 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:00.559039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:00.559910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:00.560223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:00.560505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] PATH_INFO: `/v3/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:00.561970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] RBAC: Authorizing `identity:get_role(role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:00.563336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:00.564718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 561/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:00 2022] GET /identity/v3/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:00.570396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:00.663704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1efcb-bb3c-43e0-8b8e-cfb215eaa9f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:00.673326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:00.696237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:00.697094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:00.697374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:00.697647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] PATH_INFO: `/v3/users/042c1cc5865e4821bbc54a0c1290bdc0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:00.710519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] RBAC: Authorizing `identity:get_user(user_id=042c1cc5865e4821bbc54a0c1290bdc0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:00.711969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:00.713653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 553/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:00 2022] GET /identity/v3/users/042c1cc5865e4821bbc54a0c1290bdc0 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:00.720029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:00.773487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:00.820389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b7849-df6a-462c-8e6c-21c46a2496fc None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:00.854564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:00.855146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:00.855429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:00.855703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:00.919745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:00.921219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:00.972086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:01.014192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 562/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:01.020212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:01.116100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4735afca-b4a6-42a8-a6e9-efb62a6a4ad9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:01.148067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:01.148943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:01.149229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:01.154924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:01.154924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:01.154924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f0b0fa-9fe6-4d79-95d1-1fb460cdc37b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:01.154924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 554/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:01 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:01.160620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:01.254770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14126ba-57b4-4064-9dde-5986a6d47352 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:01.287266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:01.287905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:01.288216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:01.288496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:01.289330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b, user.id=042c1cc5865e4821bbc54a0c1290bdc0) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:01.289643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:01.291355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acd9830-aa87-459a-9e11-2a41e4ff3137 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:01.296660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 563/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:01 2022] GET /identity/v3/role_assignments?user.id=042c1cc5865e4821bbc54a0c1290bdc0&scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:03.245813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c8f9-8c46-42c9-8a6d-9be3d03a6d1a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.246293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c8f9-8c46-42c9-8a6d-9be3d03a6d1a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.246293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c8f9-8c46-42c9-8a6d-9be3d03a6d1a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.247652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 555/1118] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:03.252839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.253210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.253395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.270301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:03.271464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:03.284707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:03.335549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 564/1119] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:03.358160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c8f9-8c46-42c9-8a6d-9be3d03a6d1a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:03.391952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:03.455562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c8f9-8c46-42c9-8a6d-9be3d03a6d1a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:03.487982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:03.488850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.489133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.489409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] PATH_INFO: `/v3/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.490867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] RBAC: Authorizing `identity:get_role(role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:03.492278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:03.493654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 556/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:03 2022] GET /identity/v3/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:03.499839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:03.594339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddafb37-01d4-4e69-83c0-4bac244e1334 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:03.626206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:03.627052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.627331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.627602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] PATH_INFO: `/v3/users/042c1cc5865e4821bbc54a0c1290bdc0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.628771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] RBAC: Authorizing `identity:get_user(user_id=042c1cc5865e4821bbc54a0c1290bdc0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:03.630193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:03.631785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 565/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:03 2022] GET /identity/v3/users/042c1cc5865e4821bbc54a0c1290bdc0 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:03.637328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:03.732580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9fa1-d821-489f-a422-012dac1045ba None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:03.734045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:03.765670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:03.766444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.766729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.767005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.768179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:03.769598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161239e-ed66-4fa8-825b-cf8e3ee03cd8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:03.771680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 557/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:03 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:03.777055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:03.795212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:03.874512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df147ca-4a44-483e-befb-4afc2d949c96 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:03.906608 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:03.907493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:03.907781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:03.908061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b/users/042c1cc5865e4821bbc54a0c1290bdc0/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:03.910403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ccd49adb13b467c8dab7ee9cabe384b, user_id=042c1cc5865e4821bbc54a0c1290bdc0, role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:03.911839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ed327-839e-4f45-b63f-a407e3b711d8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:03.976153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 566/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:04:03 2022] PUT /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b/users/042c1cc5865e4821bbc54a0c1290bdc0/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:04:05.932016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421882b-d255-4e33-8090-2327b60f14fb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:05.932588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421882b-d255-4e33-8090-2327b60f14fb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:05.932721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421882b-d255-4e33-8090-2327b60f14fb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:05.934110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 558/1124] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:05.939133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900379-540e-4aa2-a284-0f46499b128c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:05.939546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900379-540e-4aa2-a284-0f46499b128c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:05.939690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be900379-540e-4aa2-a284-0f46499b128c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:05.956697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-be900379-540e-4aa2-a284-0f46499b128c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:05.957862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-be900379-540e-4aa2-a284-0f46499b128c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:06.021317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 567/1125] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:06.045753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421882b-d255-4e33-8090-2327b60f14fb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:06.142765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421882b-d255-4e33-8090-2327b60f14fb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:06.174759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:06.175585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:06.175865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:06.176159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] PATH_INFO: `/v3/roles/69f349c9d1a94e819a71854d3b2abe9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:06.177593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] RBAC: Authorizing `identity:get_role(role_id=69f349c9d1a94e819a71854d3b2abe9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:06.178947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:06.180426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 559/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:06 2022] GET /identity/v3/roles/69f349c9d1a94e819a71854d3b2abe9b => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:06.186497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900379-540e-4aa2-a284-0f46499b128c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:06.194266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:06.281373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be900379-540e-4aa2-a284-0f46499b128c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:06.314407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:06.315258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:06.315538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:06.315814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] PATH_INFO: `/v3/users/042c1cc5865e4821bbc54a0c1290bdc0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:06.316999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] RBAC: Authorizing `identity:get_user(user_id=042c1cc5865e4821bbc54a0c1290bdc0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:06.318418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:06.320029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 568/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:06 2022] GET /identity/v3/users/042c1cc5865e4821bbc54a0c1290bdc0 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:04:06.325568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:06.363991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:06.421705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3531ccc-6c8f-4429-bdde-aa59e9c2d015 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:06.453255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:06.453886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:06.454169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:06.454450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:06.517967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:06.519393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:06.555796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:06.613305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 560/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:06.618979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:06.691234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:06.714911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d17c4c-8f90-40af-b0a9-c19be6556462 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:06.747201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:06.748598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:06.748880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:06.749153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] PATH_INFO: `/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:06.750337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] RBAC: Authorizing `identity:get_project(project_id=3ccd49adb13b467c8dab7ee9cabe384b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:06.751773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b56eab-b2a9-4dbf-997d-dc00adf53b8c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:06.753488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 569/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:06 2022] GET /identity/v3/projects/3ccd49adb13b467c8dab7ee9cabe384b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:04:06.759500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:06.854609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9ebc-151b-40ad-b579-8b979c5b6bb8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:06.887618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:06.888324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:06.888608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:06.888880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:06.889704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] RBAC: Adding query filter params (role.id=69f349c9d1a94e819a71854d3b2abe9b, scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b, user.id=042c1cc5865e4821bbc54a0c1290bdc0) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:06.890009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:06.891458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e860-a703-4570-8b01-7f54e6648216 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:06.897135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 561/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:06 2022] GET /identity/v3/role_assignments?user.id=042c1cc5865e4821bbc54a0c1290bdc0&scope.project.id=3ccd49adb13b467c8dab7ee9cabe384b&role.id=69f349c9d1a94e819a71854d3b2abe9b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:08.918124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603604b-dbfc-4c06-ba16-b2dd716e848d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:08.918689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603604b-dbfc-4c06-ba16-b2dd716e848d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:08.918689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603604b-dbfc-4c06-ba16-b2dd716e848d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:08.920681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 570/1131] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:08.925711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:08.926102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:08.926265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:08.931205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:08.943462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:08.947256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:09.008025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 562/1132] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:09.031841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603604b-dbfc-4c06-ba16-b2dd716e848d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:09.130621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603604b-dbfc-4c06-ba16-b2dd716e848d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:09.163244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:09.164023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:09.164330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:09.164610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:09.166031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:09.167468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff815a01-1cf9-43c3-a296-bf7b06731a09 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:09.169115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 571/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:09.175021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:09.267997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aad74b-71fe-45c1-81b7-c5d0e1d5f53c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:09.296045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:09.300617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:09.301261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:09.301542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:09.301814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:09.302505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:09.303916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28006ec-98fa-413d-94c4-9110337db4cc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:09.392208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 563/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:04:09 2022] POST /identity/v3/projects => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:04:11.407706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eae9-d2f5-40b3-b19f-b44602176770 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:11.408292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eae9-d2f5-40b3-b19f-b44602176770 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:11.408404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310eae9-d2f5-40b3-b19f-b44602176770 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:11.409690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 572/1135] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:11.415012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:11.415449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:11.415557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:11.431698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:11.432888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:11.495562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 564/1136] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:11.520017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310eae9-d2f5-40b3-b19f-b44602176770 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:11.532518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:11.616946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310eae9-d2f5-40b3-b19f-b44602176770 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:11.649157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:11.649929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:11.650213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:11.650488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:11.651628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:11.653097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83871c37-20bd-448e-ba98-a92fb9ba0361 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:11.655307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 573/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:11.660836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:11.756704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed00d70-7fee-4c6a-92dc-1dad5d9076b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:11.770455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:11.790467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:11.791415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:11.791750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:11.792023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:11.792757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:11.794237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daffe4d-b46a-44e4-857d-26e41d1ac11c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:11.891783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 565/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:04:11 2022] POST /identity/v3/users => generated 286 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:04:13.932754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973d92-0c38-4887-818b-23f019d1c571 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:13.933285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973d92-0c38-4887-818b-23f019d1c571 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:13.933285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973d92-0c38-4887-818b-23f019d1c571 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:13.935217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 574/1139] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:13.940305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:13.940721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:13.940868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:13.957647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:13.958822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:14.022213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 566/1140] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:14.045547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973d92-0c38-4887-818b-23f019d1c571 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:14.121239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:14.143135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973d92-0c38-4887-818b-23f019d1c571 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:14.176756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:14.177532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:14.177819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:14.178099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:14.187820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:14.195326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:14.196522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:14.197619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 575/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:14.202454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:14.301330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:14.304298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b72c6-ec45-421b-b6ac-23095ce04feb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:14.337392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:14.338054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:14.338333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:14.338604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:14.339341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:14.339643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:14.341737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:14.349404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 567/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:14.355294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:14.451735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db0b0b-b032-4e7f-8a24-6e5b607d9a0d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:14.483600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:14.484474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:14.484761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:14.485035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] PATH_INFO: `/v3/users/7703fd3662e1448fb03aee3da032596f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:14.492426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:14.497987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] RBAC: Authorizing `identity:get_user(user_id=7703fd3662e1448fb03aee3da032596f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:14.499410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:14.501144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 576/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/users/7703fd3662e1448fb03aee3da032596f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:14.506883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:14.603856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba4d7-120b-4d1e-9017-52a7146ccf3b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:14.634883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c666a-4064-4878-9756-149583b2872a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:14.635510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c666a-4064-4878-9756-149583b2872a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:14.635791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c666a-4064-4878-9756-149583b2872a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:14.636061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c666a-4064-4878-9756-149583b2872a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:14.667680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:14.704175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c666a-4064-4878-9756-149583b2872a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:14.705558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c666a-4064-4878-9756-149583b2872a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:14.798994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 568/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:14.804920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:14.900500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe3292-3c7b-4843-afb6-f05767fc862e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:14.932578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:14.933425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:14.933954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:14.933954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] PATH_INFO: `/v3/projects/b6d67ae479e546a49e766824031403e7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:14.935656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] RBAC: Authorizing `identity:get_project(project_id=b6d67ae479e546a49e766824031403e7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:14.937120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83348102-af9f-4ed7-8c9b-2d3ab40a2d5a None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:14.938812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 577/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/projects/b6d67ae479e546a49e766824031403e7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:14.944838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c666a-4064-4878-9756-149583b2872a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:15.003011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:15.039420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c666a-4064-4878-9756-149583b2872a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:15.072967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:15.073608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:15.073894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:15.074171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:15.075000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=b6d67ae479e546a49e766824031403e7, user.id=7703fd3662e1448fb03aee3da032596f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:15.075341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:15.076793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6093bb-7f4d-40e2-b82e-30036e2d033d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:15.082046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 569/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:14 2022] GET /identity/v3/role_assignments?user.id=7703fd3662e1448fb03aee3da032596f&scope.project.id=b6d67ae479e546a49e766824031403e7&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:17.046798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0ea2-9ab0-4057-a45c-54db105777bb None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.047338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0ea2-9ab0-4057-a45c-54db105777bb None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.047338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a0ea2-9ab0-4057-a45c-54db105777bb None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.048760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 578/1147] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:17.054048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.054414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.054607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.070856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:17.071966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:17.135547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 570/1148] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:17.157894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a0ea2-9ab0-4057-a45c-54db105777bb None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:17.218893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:17.255900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a0ea2-9ab0-4057-a45c-54db105777bb None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:17.288359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:17.289135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.289421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.289953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.300425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:17.307943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:17.309051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:17.310095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 579/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:17.315128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:17.368279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:17.409715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9f4a3-f1a7-4f1b-9e08-3b11c3096428 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:17.441659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:17.442307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.442590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.442864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.443606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:17.443909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:17.445306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:17.453567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 571/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:17.459093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:17.554094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d3951-6461-4796-b8e7-7c3a8603f2b2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:17.576320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:17.586318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:17.587174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.587460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.587740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] PATH_INFO: `/v3/users/7703fd3662e1448fb03aee3da032596f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.591451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] RBAC: Authorizing `identity:get_user(user_id=7703fd3662e1448fb03aee3da032596f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:17.591451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:17.592660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 580/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:17 2022] GET /identity/v3/users/7703fd3662e1448fb03aee3da032596f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:17.598339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:17.694758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a047a-e844-4d6e-9180-c1c68d52b08e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:17.711055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:17.726792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:17.727630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.727913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.728222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] PATH_INFO: `/v3/projects/b6d67ae479e546a49e766824031403e7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.729385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] RBAC: Authorizing `identity:get_project(project_id=b6d67ae479e546a49e766824031403e7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:17.730804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8a06f-7a26-435b-b39a-f52da280223c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:17.732575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 572/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:17 2022] GET /identity/v3/projects/b6d67ae479e546a49e766824031403e7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:17.738267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:17.836319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee58bc7-c225-4c1c-b0b3-d59a579c8d45 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:17.868106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:17.869023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:17.869306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:17.869581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] PATH_INFO: `/v3/projects/b6d67ae479e546a49e766824031403e7/users/7703fd3662e1448fb03aee3da032596f/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:17.871528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] RBAC: Authorizing `identity:create_grant(project_id=b6d67ae479e546a49e766824031403e7, user_id=7703fd3662e1448fb03aee3da032596f, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:17.873525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be05bd-4473-403f-84e0-3bdf9d84177b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:17.958793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 581/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:04:17 2022] PUT /identity/v3/projects/b6d67ae479e546a49e766824031403e7/users/7703fd3662e1448fb03aee3da032596f/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:04:19.924753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01925a0-cf5e-4c5f-86a2-db2d7fbe9875 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:19.925277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01925a0-cf5e-4c5f-86a2-db2d7fbe9875 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:19.925372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01925a0-cf5e-4c5f-86a2-db2d7fbe9875 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:19.926707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 573/1154] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:19.931921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:19.932350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:19.932516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:19.948790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:19.949977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:19.996015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:20.015042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 582/1155] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:04:20.038365 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01925a0-cf5e-4c5f-86a2-db2d7fbe9875 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:20.137296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01925a0-cf5e-4c5f-86a2-db2d7fbe9875 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:20.171576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:20.172371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:20.172655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:20.172931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:20.182999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:20.190468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:20.191534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:04:20.192458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 574/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:20.197714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:20.292961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d261-ec21-4749-a49f-9d1b4377b8f9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:20.325741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:20.326395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:20.326680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:20.326955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:20.327695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:20.327999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:20.329396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:20.337193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 583/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:20.344523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:20.388446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:20.438454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2763ac47-5790-456d-99ad-84eaf626b34f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:20.471285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:20.472159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:20.472443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:20.472714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] PATH_INFO: `/v3/users/7703fd3662e1448fb03aee3da032596f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:20.473867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] RBAC: Authorizing `identity:get_user(user_id=7703fd3662e1448fb03aee3da032596f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:20.475295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:20.476951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 575/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/users/7703fd3662e1448fb03aee3da032596f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:20.482703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:20.526515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:20.579467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a6a06f-69fe-4dbc-b87a-2e89040271b2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:20.611254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:20.611886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:20.612200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:20.612481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:20.676476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:20.677848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:20.723718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:20.785364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 584/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:20.791503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:20.886159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef1489-8f24-4dbd-b6cc-3d022f630b51 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:20.899910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:20.918831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:20.919676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:20.919958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:20.920261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] PATH_INFO: `/v3/projects/b6d67ae479e546a49e766824031403e7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:20.921413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] RBAC: Authorizing `identity:get_project(project_id=b6d67ae479e546a49e766824031403e7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:20.922838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57aac43-1caa-4fc3-8266-88ad4822365a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:20.924779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 576/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/projects/b6d67ae479e546a49e766824031403e7 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:20.933112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:21.025427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba4acf-c398-4da4-a50f-dbe5f7ed2964 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:21.058783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:21.060049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:21.060365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:21.060643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:21.061492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=b6d67ae479e546a49e766824031403e7, user.id=7703fd3662e1448fb03aee3da032596f) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:21.061803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:21.063255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603fb78-a606-4e54-8b3a-7fe83bf1caa2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:21.069436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 585/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:20 2022] GET /identity/v3/role_assignments?user.id=7703fd3662e1448fb03aee3da032596f&scope.project.id=b6d67ae479e546a49e766824031403e7&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:04:23.134332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270918-9fec-42a7-8c9e-ec2536e68420 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:23.134861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270918-9fec-42a7-8c9e-ec2536e68420 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:23.134861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b270918-9fec-42a7-8c9e-ec2536e68420 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:23.136188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 577/1162] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:23.141941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:23.142344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:23.142525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:23.158705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:23.159877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:23.161843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:23.224239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 586/1163] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:23.245924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270918-9fec-42a7-8c9e-ec2536e68420 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:23.344205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b270918-9fec-42a7-8c9e-ec2536e68420 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:23.377112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:23.377752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:23.378042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:23.378320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:23.425113 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:23.443045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:23.444541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:23.540606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 578/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:23.546994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:23.641564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b788beea-1a27-4e59-80b3-f2adf04a9f02 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:23.674282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:23.675058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:23.675387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:23.675613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:23.681995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:23.683420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:23.685104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-34032912-12bc-4a79-be4c-a73b1d7b544c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:23.697866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:23.707591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:23.708607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 587/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:04:23 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:23.709605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:23.781849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:23.799476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11f78b-bb45-4856-909a-01874bd2d4b7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:23.831857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:23.832542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:23.832825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:23.833096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:23.833807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:23.834107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:23.835459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4c1a6-6533-453e-a073-e5dc3b2cf0dd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:23.842899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 579/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Tue Jul 12 18:04:23 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:25.815911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffad-931f-4eb4-9124-7b3a1012acdf None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:25.816484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffad-931f-4eb4-9124-7b3a1012acdf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:25.816484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471ffad-931f-4eb4-9124-7b3a1012acdf None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:25.817879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 588/1167] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:25.823213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2d8c-916f-4fcc-8245-d1e8b319c293 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:25.823594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2d8c-916f-4fcc-8245-d1e8b319c293 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:25.823769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a2d8c-916f-4fcc-8245-d1e8b319c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:25.841118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-705a2d8c-916f-4fcc-8245-d1e8b319c293 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:25.842290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-705a2d8c-916f-4fcc-8245-d1e8b319c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:25.906056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 580/1168] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:25.928809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ffad-931f-4eb4-9124-7b3a1012acdf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:26.026517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471ffad-931f-4eb4-9124-7b3a1012acdf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:26.059743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:26.060422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:26.060711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:26.060992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:26.061726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:26.063085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb79d8-f775-4294-8c79-0d8aa92e66ad None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:26.137467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 589/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Tue Jul 12 18:04:25 2022] POST /identity/v3/domains => generated 267 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:04:28.150567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080396d-63b6-4b70-8711-866b5b91f5ef None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:28.151084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080396d-63b6-4b70-8711-866b5b91f5ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:28.151084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6080396d-63b6-4b70-8711-866b5b91f5ef None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:28.152451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 581/1170] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:28.158003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:28.158372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:28.158566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:28.175659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:28.176867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:28.227645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:28.241342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 590/1171] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:28.264416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080396d-63b6-4b70-8711-866b5b91f5ef None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:28.338763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:28.361845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6080396d-63b6-4b70-8711-866b5b91f5ef None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:28.393682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:28.394524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:28.394805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:28.395078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] PATH_INFO: `/v3/domains/46b554594eb444b49b2001a10fc752b4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:28.406075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46b554594eb444b49b2001a10fc752b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:28.407452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf8c9f-0f0c-450e-8e1d-8db3e2627bf6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:28.409127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 582/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Jul 12 18:04:28 2022] GET /identity/v3/domains/46b554594eb444b49b2001a10fc752b4 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:28.415165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:28.508465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebc39f-4e98-4c60-a21c-4a5827a685c9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:28.540897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:28.541538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:28.541821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:28.542101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:28.542791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:28.544823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43b282-0c75-4675-bad3-c9c8ccf1c87c None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:28.611183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 591/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:04:28 2022] POST /identity/v3/projects => generated 361 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:04:30.613294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09a0-19e6-4485-b365-708594b8a428 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:30.613826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09a0-19e6-4485-b365-708594b8a428 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:30.613826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbd09a0-19e6-4485-b365-708594b8a428 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:30.615232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 583/1174] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:30.620538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:30.620956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:30.621113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:30.637495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:30.638687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:30.672655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:30.703201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 592/1175] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:30.727478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd09a0-19e6-4485-b365-708594b8a428 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:30.829706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbd09a0-19e6-4485-b365-708594b8a428 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:30.861670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:30.862526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:30.862807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:30.863082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] PATH_INFO: `/v3/domains/46b554594eb444b49b2001a10fc752b4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:30.864305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=46b554594eb444b49b2001a10fc752b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:30.865677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f48cb3-14dc-4fe7-b7e1-cade492f7aa7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:30.867318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 584/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Tue Jul 12 18:04:30 2022] GET /identity/v3/domains/46b554594eb444b49b2001a10fc752b4 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:30.873057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:30.967740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a080a4-639f-42c7-8720-67a82e09dd6a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:31.000578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:31.001238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:31.001526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:31.001805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:31.002513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:31.003948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e608eb-be3c-40b3-b6f6-65d19bd741b1 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:31.107259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 593/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:04:30 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:04:33.124417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66aaa2-97c9-429c-8dc6-294c3e40c443 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.124916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66aaa2-97c9-429c-8dc6-294c3e40c443 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.124916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66aaa2-97c9-429c-8dc6-294c3e40c443 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.126289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 585/1178] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:33.131292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.131676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.131840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.147973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:33.149162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:33.168958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:33.212897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 594/1179] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:33.236068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66aaa2-97c9-429c-8dc6-294c3e40c443 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:33.239888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:33.334512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66aaa2-97c9-429c-8dc6-294c3e40c443 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:33.366428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:33.367205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.367491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.367767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.378655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:33.386184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:33.387283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:04:33.388201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 586/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:33.393182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:33.487355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c8ab2-f6d4-4ce4-a157-488dc6378067 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:33.518826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:33.519476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.519758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.520032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.520798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:33.521102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:33.522534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:33.530813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 595/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:33.536439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:33.597300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:33.633255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5fd94-ce17-4b2c-adb6-9d61a0314237 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:33.666245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372f365-a173-4238-a631-af486652ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:33.667105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f365-a173-4238-a631-af486652ed2d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.667387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f365-a173-4238-a631-af486652ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.667667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f365-a173-4238-a631-af486652ed2d None admin] PATH_INFO: `/v3/users/b3e7087c60b14aa4beaeb8811a3d1831` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.680807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f365-a173-4238-a631-af486652ed2d None admin] RBAC: Authorizing `identity:get_user(user_id=b3e7087c60b14aa4beaeb8811a3d1831)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:33.682239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f365-a173-4238-a631-af486652ed2d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:33.683884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 587/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:33 2022] GET /identity/v3/users/b3e7087c60b14aa4beaeb8811a3d1831 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:33.689504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:33.708164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:33.784995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821725e3-d0ed-4d36-a70a-dffc256ec6e8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:33.817560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:33.818210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:33.818494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:33.818770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:33.883148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:33.884673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:33.902087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:33.980374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 596/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:33.986378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372f365-a173-4238-a631-af486652ed2d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:34.081868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372f365-a173-4238-a631-af486652ed2d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:34.103574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:34.114488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:34.115335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:34.115617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:34.115893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] PATH_INFO: `/v3/projects/301ad8b09e2240269fbfe67fae7c112b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:34.117082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] RBAC: Authorizing `identity:get_project(project_id=301ad8b09e2240269fbfe67fae7c112b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:34.118555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bf43e-d49c-411e-ae95-ecc2bad46c1f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:34.120458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 588/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:33 2022] GET /identity/v3/projects/301ad8b09e2240269fbfe67fae7c112b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:34.126471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:34.222136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb19665b-f28b-4906-96e8-7cf70e57afc5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:34.238340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:34.254356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:34.254999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:34.255282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:34.255555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:34.256407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=301ad8b09e2240269fbfe67fae7c112b, user.id=b3e7087c60b14aa4beaeb8811a3d1831) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:34.256721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:34.258161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2c361f-74c9-4279-848e-c8368ee48b20 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:34.264044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 597/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:34 2022] GET /identity/v3/role_assignments?user.id=b3e7087c60b14aa4beaeb8811a3d1831&scope.project.id=301ad8b09e2240269fbfe67fae7c112b&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:04:36.229310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221350b-9173-452e-a627-57a9b64d896d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.229823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221350b-9173-452e-a627-57a9b64d896d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.229823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221350b-9173-452e-a627-57a9b64d896d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.231653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 589/1186] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:36.236933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.237366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.237472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.254967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:36.256167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:36.320018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 598/1187] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:36.342656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221350b-9173-452e-a627-57a9b64d896d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:36.440819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221350b-9173-452e-a627-57a9b64d896d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:36.473828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:36.474602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.474883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.475156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.484863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:36.492361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:36.493446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:04:36.494344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 590/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:36.500233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:36.594343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e887e-200e-4546-b704-c8c5307ac08d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:36.606751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:36.626966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:36.627621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.627907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.628217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.628963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:36.629273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:36.630633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:36.639238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 599/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:04:36.644927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:36.692815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:36.740239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1b862-c0a6-46fa-bd94-4f0c75acba74 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:36.772442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:36.773306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.773587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.773859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] PATH_INFO: `/v3/users/b3e7087c60b14aa4beaeb8811a3d1831` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.775014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] RBAC: Authorizing `identity:get_user(user_id=b3e7087c60b14aa4beaeb8811a3d1831)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:36.776506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:36.778148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 591/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:36 2022] GET /identity/v3/users/b3e7087c60b14aa4beaeb8811a3d1831 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:36.783945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:36.882017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8e624-3a49-48ff-a7c5-75a09dcbd5e4 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:36.913958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:36.915073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:36.915356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:36.915630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] PATH_INFO: `/v3/projects/301ad8b09e2240269fbfe67fae7c112b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:36.916819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] RBAC: Authorizing `identity:get_project(project_id=301ad8b09e2240269fbfe67fae7c112b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:36.918788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd4566-8630-409a-a901-7eb1db891901 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:36.920516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 600/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:36 2022] GET /identity/v3/projects/301ad8b09e2240269fbfe67fae7c112b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:36.926337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:37.021651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85868c-0f34-492e-ba26-0fcce6c520bf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:37.037338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:37.053669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:37.054536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:37.054817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:37.055089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] PATH_INFO: `/v3/projects/301ad8b09e2240269fbfe67fae7c112b/users/b3e7087c60b14aa4beaeb8811a3d1831/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:37.057042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] RBAC: Authorizing `identity:create_grant(project_id=301ad8b09e2240269fbfe67fae7c112b, user_id=b3e7087c60b14aa4beaeb8811a3d1831, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:37.058451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471a0348-827e-4db1-9f84-183554281c54 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:37.117925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 592/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:04:36 2022] PUT /identity/v3/projects/301ad8b09e2240269fbfe67fae7c112b/users/b3e7087c60b14aa4beaeb8811a3d1831/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:04:39.080196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a25c-1640-4dd1-ab82-070e0b58dc83 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.080734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a25c-1640-4dd1-ab82-070e0b58dc83 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.080734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d731a25c-1640-4dd1-ab82-070e0b58dc83 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.082064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 601/1193] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:04:39.087214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.087608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.087771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.104722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:04:39.105918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:04:39.170049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 593/1194] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:04:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:04:39.192591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a25c-1640-4dd1-ab82-070e0b58dc83 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:39.235942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:39.291689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d731a25c-1640-4dd1-ab82-070e0b58dc83 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:39.322881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:39.323663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.323948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.324750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.334868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:04:39.342958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:04:39.344158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:04:39.345434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 602/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:04:39.349943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:39.447949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72aa75f-0106-4a57-a9e8-9e41f014b5f3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:39.457461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:39.481355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:39.482018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.482297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.482568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.483312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:39.483614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:39.485017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:39.492754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 594/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:39.499067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:39.594195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504a896e-d037-4b70-aff4-d2ba16435dd8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:39.595606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:39.627513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:39.628385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.628665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.628935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] PATH_INFO: `/v3/users/b3e7087c60b14aa4beaeb8811a3d1831` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.630094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] RBAC: Authorizing `identity:get_user(user_id=b3e7087c60b14aa4beaeb8811a3d1831)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:39.631511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:39.633131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 603/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Tue Jul 12 18:04:39 2022] GET /identity/v3/users/b3e7087c60b14aa4beaeb8811a3d1831 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:39.639287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:39.739370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e4d39-90bb-48c3-9a3d-2cf76514815b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:39.776218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:39.776862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:39.777203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:39.777485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:39.815091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:39.842091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:39.847865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:39.938520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 595/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:04:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:04:39.944384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:40.039049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354bb7-de5e-44b1-931a-687ef40581f2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:40.075453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:40.076316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:40.076600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:40.076871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] PATH_INFO: `/v3/projects/301ad8b09e2240269fbfe67fae7c112b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:40.078019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] RBAC: Authorizing `identity:get_project(project_id=301ad8b09e2240269fbfe67fae7c112b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:40.079438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf93519-479a-4025-9ff2-4fb39f0fc301 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:40.081150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 604/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Tue Jul 12 18:04:39 2022] GET /identity/v3/projects/301ad8b09e2240269fbfe67fae7c112b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:40.088488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:04:40.154800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:40.183880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3cde6-c6e8-4c21-9c18-f9e98089701e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:04:40.216410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:04:40.217053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:04:40.217339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:04:40.217626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:04:40.218448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=301ad8b09e2240269fbfe67fae7c112b, user.id=b3e7087c60b14aa4beaeb8811a3d1831) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:04:40.218761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:04:40.220210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb54-dbf3-4226-aee4-7892809b829e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:04:40.225829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 596/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:04:40 2022] GET /identity/v3/role_assignments?user.id=b3e7087c60b14aa4beaeb8811a3d1831&scope.project.id=301ad8b09e2240269fbfe67fae7c112b&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:04:50.071152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:04:50.223285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=33 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:50.307371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dc92f-e1fd-4205-a5c1-a1b73770c420 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:50.307940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dc92f-e1fd-4205-a5c1-a1b73770c420 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:50.307940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10dc92f-e1fd-4205-a5c1-a1b73770c420 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:50.309309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 605/1201] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:05:50.314500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:50.315784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:50.315784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:50.331877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:05:50.333083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:05:50.397358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 597/1202] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:05:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:05:50.421895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dc92f-e1fd-4205-a5c1-a1b73770c420 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:50.520398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10dc92f-e1fd-4205-a5c1-a1b73770c420 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:50.556723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:50.557576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:50.557798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:50.558073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:50.567776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:50.569283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:05:50.586466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:50.604163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:50.605370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:05:50.605370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:05:50.605370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:50.605370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:05:50.605370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 606/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:05:50.605759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:50.690824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d208d5e-c134-473c-a940-15f45dcf6805 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:50.718557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:50.724274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:50.734661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8307d-0e56-4084-905b-e33354a78936 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:50.738842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 598/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:50.745038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:50.796447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:50.841515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2222ae66-0aad-4018-9298-93d16206c3a8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:50.874607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:50.875275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:50.875562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:50.875840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:50.876593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:50.878005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625aea2-ec62-46c3-8dcc-78259b2f146f None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:50.984554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 607/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Tue Jul 12 18:05:50 2022] POST /identity/v3/users => generated 251 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:05:53.010034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856728ed-74bd-473b-a5de-f7658bf541f9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.010577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856728ed-74bd-473b-a5de-f7658bf541f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.010577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856728ed-74bd-473b-a5de-f7658bf541f9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.011972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 599/1206] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:05:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:05:53.017009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.017486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.017586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.034527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:05:53.035754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:05:53.101829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 608/1207] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:05:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:05:53.125662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856728ed-74bd-473b-a5de-f7658bf541f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:53.225724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856728ed-74bd-473b-a5de-f7658bf541f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:53.258707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:53.260027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.260333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.260607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.273991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:05:53.282313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:53.283467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:53.285393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 600/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:53.290383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:53.328975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:53.386178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6ec10a-0217-446d-a313-b388e71252c6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:53.418592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:53.419293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.419574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.420028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.420615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:53.420920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:53.422278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:53.429941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 609/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:53.435863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:53.487414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:53.536633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a179dba-5e0e-43d3-9b9e-5ecfbc6a1584 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:53.570105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:53.570890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.571175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.571989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.581843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:53.583285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:05:53.600846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:53.601877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:53.603124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:05:53.603124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:05:53.603124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:53.603124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:53.603124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 601/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:05:53.607842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:53.704400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:53.707275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4ff8-6f89-4aed-aa05-319f1e6eb7c3 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:53.739407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:53.740067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.740391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.740677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.741445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:53.741740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:53.743121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:53.755688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 610/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:53.762052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:53.860014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f536f8f-e286-4c23-b934-095191e38d76 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:53.861558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:53.893958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:53.894756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:53.895042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:53.895318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:53.902086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:53.903535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:05:53.918068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:53.919182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:53.920364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 602/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:53.925139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.021962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043dc4b-7753-489f-a6cb-92fdc0b8f6f8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:54.055289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:54.056535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:54.056822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:54.057098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:54.057996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:54.058301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:54.059740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:54.076581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 611/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:05:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:54.082320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.180103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4d38-1807-4fb3-aa2f-4007e3539c0f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:54.214510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:54.215142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:54.215425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:54.215701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:54.244859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:54.279949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:54.281371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:54.376596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 603/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:05:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:05:54.382538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.401755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:54.480194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc7e1a-e689-4376-b58a-6e0b5691116e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:54.515563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:54.516454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:54.516739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:54.517015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:54.527021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:54.528532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:05:54.545643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:54.546757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:54.547861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:05:54.547861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:05:54.547861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:54.547861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:05:54.547861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 612/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:54.552506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.615853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:54.664561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71d829-1a57-4736-a267-b5da7c5ab9f1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:54.699143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:54.699818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:54.700100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:54.700456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:54.701192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:54.701568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:54.702953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:54.714650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 604/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:54.720466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.788463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:54.818300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3e3a-c809-49c5-95f5-d0adeac48fe2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:54.850438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:54.851218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:54.851501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:54.851775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:54.858748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:54.860196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:05:54.873980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:54.875002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:05:54.876000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 613/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:54.881160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:54.983290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd1676f-aa5a-4a2f-a5b3-3cacb3ee3850 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:55.005846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:55.017161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:55.017813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:55.018095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:55.018368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:55.019197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:55.019502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:55.020952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cada53-1e20-4979-bd88-c6ac9596c96e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:55.033464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 605/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:55.039673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:55.139404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb47fd6-ca2b-4cfa-956b-70ff7489d488 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:55.169147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:55.175225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:55.175886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:55.176203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:55.176484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:55.177434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=6bf6579be6b84cefb9bafe082cfa19f4) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:55.177769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:55.179301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96905a-b1cc-4391-a7a8-6a5232b71ca0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:55.184910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 614/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:05:55 2022] GET /identity/v3/role_assignments?user.id=6bf6579be6b84cefb9bafe082cfa19f4&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:57.167075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a432-d4c6-47ab-b727-380666ccb4b2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.167606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a432-d4c6-47ab-b727-380666ccb4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.167606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4a432-d4c6-47ab-b727-380666ccb4b2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.168952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 606/1220] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:05:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:05:57.174373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.174793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.174930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.192231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:05:57.193411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:05:57.260060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 615/1221] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:05:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:05:57.282369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a432-d4c6-47ab-b727-380666ccb4b2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:57.381469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4a432-d4c6-47ab-b727-380666ccb4b2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:57.415630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:57.416459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.416747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.417023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.427144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:05:57.434881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:57.435903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:57.436803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 607/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:05:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:57.442324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:57.539118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b2955-a9b4-45e9-9f69-d9c11bd9e5c2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:57.563031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:57.573267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:57.573928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.574208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.574479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.575214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:57.575517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:57.576913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:57.584516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 616/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:05:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:05:57.590775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:57.632400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:57.687963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858874b-a55f-45f1-8274-0546a925f615 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:57.719743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:57.720539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.720817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.721084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.731561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:57.733015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:05:57.749155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:57.750240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:57.751233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:05:57.751233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:05:57.751233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:57.751233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:57.751233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 608/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:57.756173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:57.854494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911f2d69-b31e-407e-881d-f6d896444a8d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:57.886156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:57.886808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:57.887089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:57.887372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:57.888091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:57.888424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:57.889783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:57.901527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 617/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:05:57.907590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.002160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:58.008597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c2c44-0e12-4f7e-bba3-69ef060f65eb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.041474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.042274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.042541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.042813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.049910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.051339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:05:58.065271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:58.066354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:58.067720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 609/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:58.073116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.118653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:58.168863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d5de4-d6e5-493a-abd4-d3d1c12f31fd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.203230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.203897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.204207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.204485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.205311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:58.205620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.207038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.223560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 618/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:05:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:58.229286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.328415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bc94c-83b9-4903-8721-805487d15878 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.360599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.361381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.361665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.361941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.372651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.374103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:05:58.391134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:58.392192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:58.393403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:05:58.393403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:05:58.393403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:05:58.393403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:58.393403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 610/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:58.398189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.494527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db4fee-8a6f-4048-b69a-4f90e794662e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.496805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:58.528027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.528718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.529006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.529288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.530010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:58.530322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.531695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.543904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 619/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:58.549517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.559446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:58.645037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903c51d-c93b-440a-a4fd-7827a09b6ec5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.676917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.677697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.677978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.678253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.685182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.686629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:05:58.701749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:05:58.702818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:05:58.703874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 611/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:05:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:05:58.708804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.807379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec22bc8-77bc-446f-8778-18d0b15b1f2b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.840434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.841100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.841386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.841660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:58.842448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:05:58.842757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:58.844225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5b1b57-7753-4b3b-8dd2-e8c2bc5db0f6 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:58.856471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 620/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:05:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:05:58.862471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:05:58.927955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:05:58.960513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4284c49-0e08-4adb-922d-00c0c81d057a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:05:58.994695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:05:58.995621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:05:58.995945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:05:58.996241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/6bf6579be6b84cefb9bafe082cfa19f4/roles/ae7af48074714053ba5ba35851b8ee53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:05:59.010428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=6bf6579be6b84cefb9bafe082cfa19f4, role_id=ae7af48074714053ba5ba35851b8ee53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:05:59.011861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a9c10-a269-41e6-81ff-f0a21801c015 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:05:59.087750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 612/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:05:58 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/6bf6579be6b84cefb9bafe082cfa19f4/roles/ae7af48074714053ba5ba35851b8ee53 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:06:01.076294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042675-f581-4880-b199-2ed0f97b2fc8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.076775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042675-f581-4880-b199-2ed0f97b2fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.076775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042675-f581-4880-b199-2ed0f97b2fc8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.078067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 621/1233] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:01.083100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.083515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.083661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.100841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:01.102023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:01.167905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 613/1234] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:01.191122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042675-f581-4880-b199-2ed0f97b2fc8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:01.216447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:01.290833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042675-f581-4880-b199-2ed0f97b2fc8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:01.325606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:01.326443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.326676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.326944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.336748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:06:01.344510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:01.345738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:01.346611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 622/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:01.351712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:01.396341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:01.447833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07e4e0-868a-413d-9dd1-c8606118dec5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:01.480704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:01.481363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.481644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.481917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.482695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:01.483000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:01.484394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:01.492324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 614/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:01.498563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:01.581351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:01.596401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f5e21-ec8d-424d-aff9-c6b00b7263c5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:01.629225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:01.630075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.630363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.630642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.641199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:01.642717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:01.659816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:01.660939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:01.662142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:01.662142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:01.662142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:01.662142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:01.662142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 623/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:01.667492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:01.764887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8377fd2-d68f-40ef-9a16-d0589c9e0fe0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:01.773451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:01.797649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:01.798300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.798585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.798863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.799579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:01.799888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:01.801290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:01.813170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 615/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:01.818707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:01.917143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc475408-871b-4143-93f6-e3c077a5ea95 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:01.949092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:01.949883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:01.950163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:01.950436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:01.953040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:01.957977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:01.959408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:06:01.973799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:01.979110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 624/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:01.981279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:02.079125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e289e88-5f3d-404b-931e-95de41599c4e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:02.113577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:02.114244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:02.114530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:02.114851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:02.115682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:02.115995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:02.117460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:02.134322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 616/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:06:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:02.140261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:02.237544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fecbc3-0b7a-4687-8ab1-9625258d2dc7 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:02.269682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:02.270323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:02.270605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:02.270880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:02.331582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:02.338694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:02.340182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:02.434390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 625/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:06:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:06:02.440253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:02.467931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:02.537513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e067f-7d43-4332-a424-a9ba5983ebff None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:02.572058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:02.572868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:02.573148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:02.573420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:02.582980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:02.584441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:02.601861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:02.603020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:02.604084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:02.604084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:02.604084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:02.604084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:02.604084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 617/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:02.608868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:02.699562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:02.705178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9405911-17a2-43cf-96d2-8235b2f56dcd None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:02.736810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:02.737494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:02.737778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:02.738053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:02.738767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:02.739072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:02.740456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:02.752072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 626/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:02.757709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:02.836692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:02.857114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15f4de-fab7-4e48-b7c3-2b1a7e0e3717 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:02.890172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:02.890952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:02.891236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:02.891513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:02.898075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:02.899563 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:06:02.914272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:02.915367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:02.916686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 618/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:06:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:02.921435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:03.019866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ad52d-c305-48fb-99c8-0160d2f11d75 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:03.053212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:03.053863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:03.054146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:03.054419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:03.055837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:03.056172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:03.057638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95b15c-9beb-4997-8231-87e3b33aaf53 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:03.069494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 627/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:06:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:06:03.075741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:03.172291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b35a28-e6f5-4a76-8d83-89c9c9bcb20e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:03.204780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:03.205420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:03.205699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:03.205971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:03.206831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] RBAC: Adding query filter params (role.id=ae7af48074714053ba5ba35851b8ee53, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=6bf6579be6b84cefb9bafe082cfa19f4) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:03.207157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:03.208593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a0cbf7-d066-4083-932a-307dc5a276e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:03.214308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 619/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:06:03 2022] GET /identity/v3/role_assignments?user.id=6bf6579be6b84cefb9bafe082cfa19f4&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=ae7af48074714053ba5ba35851b8ee53 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:05.279593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de3c7-31ec-4a2c-bbaa-3335fb6e3d95 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.280110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de3c7-31ec-4a2c-bbaa-3335fb6e3d95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.280110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539de3c7-31ec-4a2c-bbaa-3335fb6e3d95 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.281536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 628/1247] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:05.286576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.286976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.287130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.292519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:05.304186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:05.308353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:05.368516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 620/1248] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:05.392080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de3c7-31ec-4a2c-bbaa-3335fb6e3d95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:05.410322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:05.490960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539de3c7-31ec-4a2c-bbaa-3335fb6e3d95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:05.524747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:05.525533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.525816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.526198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.536000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:06:05.543829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:05.544969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:05.545824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 629/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:06:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:05.551224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:05.647280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a89d2c-0156-4939-bfc2-67780b1e586d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:05.674967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:05.679562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:05.680814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.681101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.681374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.682115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:05.682415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:05.683776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:05.691510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 621/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:06:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:05.698053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:05.772148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:05.794292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045d60d-3695-4717-a2d7-c91a3cbf8beb None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:05.827137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:05.827925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.828235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.828511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.839348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:05.840883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:05.857044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:05.858655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:05.859611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:05.859611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:05.859611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:05.859611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:05.859611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 630/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:05.864014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:05.961061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef57607d-c0e6-488f-88d2-f0bb0fad5748 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:05.993287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:05.994020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:05.994305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:05.994579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:05.995297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:05.995604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:05.996999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.009605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 622/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:06.015237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:06.112260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14635dcd-0f9a-4489-b92a-e3ea2a785e10 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:06.137666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:06.145230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:06.146047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:06.146327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:06.146598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:06.153951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:06.155410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:06:06.170071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:06.171190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:06.172390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 631/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:06.177143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:06.231060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:06.273271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3df9fd-65e6-4e4a-ad12-0684584f43d9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:06.306941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:06.307608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:06.307893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:06.308197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:06.309048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:06.309403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:06.310837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.329309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 623/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:06.335093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:06.432630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d36cc-ebcc-4996-80d4-65fe7dcfa1d5 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:06.465591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:06.466236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:06.466520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:06.466794 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:06.519509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:06.531300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:06.532804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.627458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 632/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:06:06.633276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:06.735408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33607aa6-001f-42f6-ac7c-cec7f3166fbc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:06.748961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:06.768722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:06.769509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:06.769798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:06.770074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:06.779739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:06.781227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:06.798831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:06.799871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:06.805446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:06.805446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:06.805446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:06.805446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:06.805446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 624/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:06.805812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:06.890611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:06.901835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a415b7a7-36a3-4341-b3a1-af9a64a095ba None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:06.935270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:06.935929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:06.936247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:06.936527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:06.937246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:06.937551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:06.938917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:06.949707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 633/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:06.955415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:07.051985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f0c63c-cecf-40cf-bbec-42419d785886 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:07.084586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:07.085350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:07.085633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:07.085911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:07.092853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:07.094282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:06:07.108147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:07.109239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:07.115074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 625/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:06:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:07.115659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:07.212341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a6e98f-edeb-4997-b8aa-53fd0ada1488 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:07.251316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:07.252034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:07.252318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:07.252598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:07.253391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:07.253709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:07.255164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75966fa-4531-4f15-ad76-063254850335 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:07.267042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 634/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:06:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:07.273181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:07.299911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:07.379035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ea94e-b539-41d6-b658-e1ccfda62323 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:07.411941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:07.412628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:07.412894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:07.413420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:07.414286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=6bf6579be6b84cefb9bafe082cfa19f4) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:07.414598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:07.416725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309ad221-cdf1-433f-86e8-a4c7b1ed93b0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:07.422019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 626/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:06:07 2022] GET /identity/v3/role_assignments?user.id=6bf6579be6b84cefb9bafe082cfa19f4&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:09.408631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8040a-f3bb-43a4-8863-63f2a5fab0aa None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:09.409177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8040a-f3bb-43a4-8863-63f2a5fab0aa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:09.409296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad8040a-f3bb-43a4-8863-63f2a5fab0aa None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:09.410589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 635/1261] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:09.416636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:09.417053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:09.417194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:09.434258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:09.435616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:09.501953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 627/1262] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:09.524322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8040a-f3bb-43a4-8863-63f2a5fab0aa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:09.535686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:09.624946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad8040a-f3bb-43a4-8863-63f2a5fab0aa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:09.658473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:09.659316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:09.659547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:09.659824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:09.670884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:06:09.691866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:09.693125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:09.694184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 636/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:06:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:09.695045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:09.705242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:09.782483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb0b3f-685d-4cae-bf9e-e8c584855e58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:09.816815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:09.817400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:09.817687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:09.817957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:09.818700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:09.819002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:09.820430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:09.829290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 628/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:06:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:09.835027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:09.902935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:09.935424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f0182-4117-4eb4-afbc-31f1dafff1b8 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:09.968712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:09.969498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:09.969778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:09.970046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:09.980776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:09.982223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:10.005369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:10.006411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:10.007344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:10.007344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:10.007344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:10.007344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:10.007344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 637/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:10.013654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.093410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:10.111657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36c9a45-21ca-447c-b9d0-5a19f8f0cc44 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.144624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.145275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.145555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.145826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.146541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:10.146842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.148221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.159758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 629/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:10.165977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.263834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba4f-6355-4605-8982-ab0047ed9a6e None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.283774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:10.297563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.298362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.298644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.298918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.306900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.308362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:06:10.323413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:10.325335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:10.326619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 638/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:06:10.330615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.433186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e2701f-49be-443b-8164-a1a4306f02f0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.465821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.466480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.466762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.467037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.467863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:10.468195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.469614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.478438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:10.486987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 630/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:10.492559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.591637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48e9fd5-6174-4116-bbef-99c4f2c706f0 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.624743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.625528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.625811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.626081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.637155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.638601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:10.655215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:10.656336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:10.657630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:10.657630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:10.657630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:10.657630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:10.657630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 639/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:10.662116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.761519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66071f59-93e8-4766-b7a8-958e501135bc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.795834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.796522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.796810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.797089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.797812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:10.798119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.799489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.813888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 631/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:10.819589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:10.850480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:10.916537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55439cb1-7242-4d9b-96a8-19f64322284b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:10.948830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:10.949649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:10.949932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:10.950201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:10.956688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:10.958279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:06:10.971742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:10.972976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:10.974359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 640/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 18:06:10.978744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:11.036035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:11.077352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551971a5-c56a-4475-bbd1-f4e412ec43e9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:11.108975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:11.109579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:11.109860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:11.110119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:11.110892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:11.111232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:11.112691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2429c5b-cbac-4204-9b4e-ee815057ed62 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:11.125875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 632/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:06:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:11.131926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:11.221666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:11.231281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482639-5cc7-4830-a618-c525baf2bc3b None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:11.264896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:11.265815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:11.266106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:11.266387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] PATH_INFO: `/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/6bf6579be6b84cefb9bafe082cfa19f4/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:11.268502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] RBAC: Authorizing `identity:create_grant(project_id=2fa95e8be2704b38b0d147a42176e3ba, user_id=6bf6579be6b84cefb9bafe082cfa19f4, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:11.269889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06d82b-73af-43e7-ada8-b66575484812 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:11.356130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 641/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Tue Jul 12 18:06:11 2022] PUT /identity/v3/projects/2fa95e8be2704b38b0d147a42176e3ba/users/6bf6579be6b84cefb9bafe082cfa19f4/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:06:13.358092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286a6c-78f4-4da9-a199-306bf77455df None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:13.358619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286a6c-78f4-4da9-a199-306bf77455df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:13.358735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e286a6c-78f4-4da9-a199-306bf77455df None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:13.360149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 633/1274] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:13.365390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:13.365806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:13.365959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:13.382482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:13.383707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:13.450148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 642/1275] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:13.473247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286a6c-78f4-4da9-a199-306bf77455df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:13.573426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e286a6c-78f4-4da9-a199-306bf77455df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:13.590889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:13.606688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:13.607466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:13.607746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:13.608017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:13.617775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 18:06:13.625210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:13.626337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:13.627677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 634/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Tue Jul 12 18:06:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:13.632336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:13.713182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:13.730915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481fbee-fda0-40a8-9b0b-978ce98ce2df None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:13.764060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:13.767731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:13.776060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 643/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Tue Jul 12 18:06:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:13.781741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:13.882434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3ece-6aa2-4d6d-8541-d4a51b176bdb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:13.914945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:13.915762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:13.916045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:13.916346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:13.926414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:13.927848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:13.945090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:13.947278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:13.948548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:13.948548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:13.948548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:13.948548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:13.948548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 635/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:13.952910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:14.049756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb6672-a750-40da-b0d9-de5edb26ce99 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:14.082826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:14.083484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:14.083768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:14.084046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:14.084800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:14.085107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:14.086543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:14.099115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 644/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:14.104764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:14.135954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:14.203174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7be55a-0b65-4f73-b380-29c82089e714 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:14.236019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:14.236827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:14.237109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:14.237382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:14.245173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:14.246622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 18:06:14.260671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:14.261814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:14.262781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 636/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:14.267569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:14.271423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:14.365052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73808c-6a56-4319-839d-3ed68d81cc5d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:14.398318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:14.398921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:14.399205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:14.399482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:14.400399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:14.400708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:14.402147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:14.419577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 645/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Tue Jul 12 18:06:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:14.425238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:14.515215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:14.524355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f0b8dd-dc34-4996-a30a-994e10af03d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:14.557797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:14.558440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:14.558726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:14.559007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:14.626083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:14.627540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:14.722426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:14.732713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 637/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Tue Jul 12 18:06:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 18:06:14.739120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:14.800476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:14.839041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b01d0da-a2c8-4969-a5a7-979159bd29a2 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:14.872176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:14.872998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:14.873285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:14.873561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:14.883380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:14.885557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 18:06:14.902526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:14.903583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:14.904896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 18:06:14.904896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 18:06:14.904896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 18:06:14.904896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:14.904896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 646/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:14.909431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:15.009792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931e9d7-1ee5-471b-9858-a69142f858ce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:15.042919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:15.043582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:15.043864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:15.044159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:15.044881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:15.045185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:15.046559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:15.058755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 638/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Tue Jul 12 18:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:15.064409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:15.160827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd54b328-250b-45b6-8a1e-11b455977150 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:15.175170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:15.195251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:15.196029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:15.196343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:15.196643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:15.203098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:15.204566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 18:06:15.218392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:15.219443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: ERROR keystone.server.flask.application Jul 12 18:06:15.220492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 647/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Tue Jul 12 18:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:15.225549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:15.275214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:15.325454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda4f0a-db89-448a-bb7b-d0e3c7c2ecb0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:15.359762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:15.360454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:15.360733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:15.361006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:15.361804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:15.362095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:15.363559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802de6c-60a8-4406-a951-812349d19e2f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:15.375572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 639/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Tue Jul 12 18:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:15.381715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:15.479800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf2a23c-4bb3-4604-a07a-e7d0d4c74028 None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:15.512441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:15.513096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:15.513387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:15.513672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:15.514505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] RBAC: Adding query filter params (role.id=7d08fb98b09c4c7c80af084a6709b7cb, scope.project.id=2fa95e8be2704b38b0d147a42176e3ba, user.id=6bf6579be6b84cefb9bafe082cfa19f4) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:15.514822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:15.516301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afa6cb-0658-422e-82ae-b2b0a9f712f9 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:15.521978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 648/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Tue Jul 12 18:06:15 2022] GET /identity/v3/role_assignments?user.id=6bf6579be6b84cefb9bafe082cfa19f4&scope.project.id=2fa95e8be2704b38b0d147a42176e3ba&role.id=7d08fb98b09c4c7c80af084a6709b7cb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:17.544488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db527-0e6f-4858-b74b-e3ce1f3c9de4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:17.545043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db527-0e6f-4858-b74b-e3ce1f3c9de4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:17.545043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263db527-0e6f-4858-b74b-e3ce1f3c9de4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:17.546419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 640/1288] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:17.551664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:17.552067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:17.552260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:17.569610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:17.570838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:17.600297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:17.636890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 649/1289] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:17.658784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db527-0e6f-4858-b74b-e3ce1f3c9de4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:17.757001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263db527-0e6f-4858-b74b-e3ce1f3c9de4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:17.768005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:17.790413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:17.791181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:17.791465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:17.791741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:17.792425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:17.793795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:17.805556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:17.807247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:17.808204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 641/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:06:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:17.813335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:17.911003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206b2a9f-e692-4eb9-a02b-005690d9a020 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:17.943404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:17.944078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:17.944393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:17.944667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:17.945366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:17.945668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:17.947593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c54f5-8fad-43c8-b3e5-0e42e8fb12a8 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:17.952320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 650/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Jul 12 18:06:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:17.958169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:18.054912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a25de0e-d75c-4600-97e4-d1c24d623561 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:18.087627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:18.088248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:18.088529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:18.088800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:18.089500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:18.089802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:18.091155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850394b9-1b5a-4e60-94d6-03a41ab8721f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:18.095910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 642/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Jul 12 18:06:17 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:20.097191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f3cd-a8f6-4ba6-85fb-11c8761b91b9 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:20.097674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f3cd-a8f6-4ba6-85fb-11c8761b91b9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:20.097674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d423f3cd-a8f6-4ba6-85fb-11c8761b91b9 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:20.099073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 651/1293] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:20.104209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2209c-709c-4782-a989-00bc9235b3bf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:20.104603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2209c-709c-4782-a989-00bc9235b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:20.104771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f2209c-709c-4782-a989-00bc9235b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:20.122442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-17f2209c-709c-4782-a989-00bc9235b3bf None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:20.123611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17f2209c-709c-4782-a989-00bc9235b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:20.152846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:20.189062 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 643/1294] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:20.212229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f3cd-a8f6-4ba6-85fb-11c8761b91b9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:20.244362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:20.313640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d423f3cd-a8f6-4ba6-85fb-11c8761b91b9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:20.346931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:20.347632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:20.347870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:20.348167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:20.348897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:20.350253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd86a3-fd0a-4971-b1c2-35b270773038 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:20.470067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 652/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Tue Jul 12 18:06:20 2022] POST /identity/v3/services => generated 246 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:06:22.472508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80117-8239-4a94-bf32-aef5a4dd7ea6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:22.473028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80117-8239-4a94-bf32-aef5a4dd7ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:22.473120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc80117-8239-4a94-bf32-aef5a4dd7ea6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:22.474455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 644/1296] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:22.480340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:22.480744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:22.480882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:22.496929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:22.498113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:22.567495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 653/1297] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:22 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 18:06:22.591439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80117-8239-4a94-bf32-aef5a4dd7ea6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:22.690092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc80117-8239-4a94-bf32-aef5a4dd7ea6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:22.723595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:22.724352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:22.724637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:22.724912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:22.725706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:22.727195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:22.739389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:22.740465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:22.741419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 645/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:06:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:22.746751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:22.765073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:22.844257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c622ce2c-0555-4940-96ae-356fc82c5895 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:22.877151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:22.877817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:22.878104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:22.878382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:22.879091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:22.879401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:22.880846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:22.887582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 654/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Jul 12 18:06:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:22.892536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:22.923380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:22.989270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ce1f0-99fe-40cf-87cf-24f8023c4685 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:23.023704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:23.024434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:23.024716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:23.024992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:23.025781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] RBAC: Adding query filter params (interface=public, service_id=ccad9dde748243478f9b023686de12d7, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:23.026093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:23.027463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570a78c-90ee-446a-8258-873cdde06e6f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:23.032498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 646/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Tue Jul 12 18:06:22 2022] GET /identity/v3/endpoints?service_id=ccad9dde748243478f9b023686de12d7&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:23.038293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:23.119855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:23.137435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e34246-3b50-4c7b-bf01-463a3be0424d None admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:23.169557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:23.170210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:23.170493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:23.170767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:23.171480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:23.172980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22104da8-74da-499a-845f-c51ce362c043 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:23.181172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 655/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Tue Jul 12 18:06:23 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:06:25.178754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1c51-2adc-430e-ba94-ce65b483d057 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:25.179271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1c51-2adc-430e-ba94-ce65b483d057 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:25.179271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e1c51-2adc-430e-ba94-ce65b483d057 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:25.180678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 647/1302] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:06:25.185798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:25.186192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:25.186351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:25.202075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:06:25.203250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:06:25.268099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 656/1303] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:06:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 18:06:25.292106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1c51-2adc-430e-ba94-ce65b483d057 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:25.386085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:25.392564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e1c51-2adc-430e-ba94-ce65b483d057 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:25.425438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:25.426227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:25.426507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:25.426779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:25.427425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:25.428867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 18:06:25.440388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 18:06:25.445747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 12 18:06:25.446805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 648/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Tue Jul 12 18:06:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 18:06:25.447615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:25.522434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:25.544495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f4760-f49d-44c3-ab51-437a3ce6a924 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:25.575888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:25.576562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:25.576871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:25.577312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] PATH_INFO: `/v3/services` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:25.578267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:06:25.578986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:25.580409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1720c8-bbec-44b5-805d-533cb76b52f0 None admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:25.585418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 657/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Tue Jul 12 18:06:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:06:25.591771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:06:25.697862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a79c8-f5b4-46fd-930b-e8353d09e7bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:06:25.730363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:06:25.731013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:06:25.731299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:06:25.731575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:06:25.732335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:06:25.733704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d61ab7-49af-4711-b831-cf75184d919e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:06:25.875367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 649/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Tue Jul 12 18:06:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:06:35.582416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=30 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:06:35.870620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:24.413452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b786e76-3a71-4490-8e18-a2a7b8ed0796 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:24.414499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b786e76-3a71-4490-8e18-a2a7b8ed0796 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:24.415010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b786e76-3a71-4490-8e18-a2a7b8ed0796 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:24.422764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066d1c-1ebe-401b-a643-d2a62e7bb273 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:24.423641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066d1c-1ebe-401b-a643-d2a62e7bb273 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:24.424158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f066d1c-1ebe-401b-a643-d2a62e7bb273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:24.427593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 658/1307] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:24.502803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f066d1c-1ebe-401b-a643-d2a62e7bb273 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:24.503993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f066d1c-1ebe-401b-a643-d2a62e7bb273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:24.651131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 650/1308] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:24.717672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:24.718080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:24.718482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:24.719986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 659/1309] 10.222.0.33 () {54 vars in 964 bytes} [Tue Jul 12 18:12:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:24.728806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06adadc-9484-4c60-91d9-c75683d5fd73 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:24.729107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06adadc-9484-4c60-91d9-c75683d5fd73 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:24.729380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06adadc-9484-4c60-91d9-c75683d5fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:24.820145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d06adadc-9484-4c60-91d9-c75683d5fd73 None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:24.821539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d06adadc-9484-4c60-91d9-c75683d5fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:24.844438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:24.913000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 651/1310] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Jul 12 18:12:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:24.913942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:24.916081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:25.039400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85170483-87f1-4cc8-b365-b502508e21e8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:25.117042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:25.117707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:25.117996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:25.118276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:25.119928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:25.177297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:25.233131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:25.235098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d409c-da10-4c35-a0b7-e52200f88a85 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:25.254624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 660/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:12:27.535754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70e14-2930-4872-82e0-25456a010d02 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:27.536321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70e14-2930-4872-82e0-25456a010d02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:27.536411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf70e14-2930-4872-82e0-25456a010d02 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:27.537746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 652/1312] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:27.543334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5b19-ae28-4630-a147-615cac6a4430 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:27.543747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5b19-ae28-4630-a147-615cac6a4430 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:27.543902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb5b19-ae28-4630-a147-615cac6a4430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:27.633249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1ccb5b19-ae28-4630-a147-615cac6a4430 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:27.634499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ccb5b19-ae28-4630-a147-615cac6a4430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:27.737408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 661/1313] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:27.787440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:27.787679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:27.787962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:27.789383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 653/1314] 10.222.0.33 () {54 vars in 964 bytes} [Tue Jul 12 18:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:27.795916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66c45-f1e9-48cc-9de0-c6e05a154b2e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:27.796238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66c45-f1e9-48cc-9de0-c6e05a154b2e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:27.796526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b66c45-f1e9-48cc-9de0-c6e05a154b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:27.806916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:27.874506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-95b66c45-f1e9-48cc-9de0-c6e05a154b2e None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:27.875741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-95b66c45-f1e9-48cc-9de0-c6e05a154b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:27.950938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 662/1315] 10.222.0.33 () {58 vars in 1061 bytes} [Tue Jul 12 18:12:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:27.960675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:27.962160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:28.064136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c091d-ecaa-44d7-898a-958988ebcd49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:28.132709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:28.135170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:28.135809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:28.136091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:28.136400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:28.138025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:28.245734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:28.247157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6c927f-bb87-42e8-99a6-fde3b04f30c5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:28.264880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 654/1316] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:31.054484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:31.055022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:31.055122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:31.056459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 663/1317] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:31.061617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185f72-e25d-4549-9d7f-30ec3d7e237a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:31.062025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185f72-e25d-4549-9d7f-30ec3d7e237a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:31.062177 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61185f72-e25d-4549-9d7f-30ec3d7e237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:31.125186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61185f72-e25d-4549-9d7f-30ec3d7e237a None None] MFA Rules not processed for user `c6ae44ed6e014d21a3fad60503910b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:31.126396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61185f72-e25d-4549-9d7f-30ec3d7e237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:31.177436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:31.222112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 655/1318] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:31 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:31.261668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:31.263225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:31.364547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc14c8-c7c9-420a-9b0f-dfe79a3dc40f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:31.367310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:31.438470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:31.439151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:31.439438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:31.439715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:31.441389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:31.544948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:31.546928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7333dd-a881-46c2-98b1-28c55a35498f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:31.565636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 664/1319] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:31 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:34.455984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:34.456543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:34.456723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:34.458208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 656/1320] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:34.463434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0e1a-9e6a-4c56-ae13-c376a0e49fef None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:34.463846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0e1a-9e6a-4c56-ae13-c376a0e49fef None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:34.463994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f0e1a-9e6a-4c56-ae13-c376a0e49fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:34.503028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:34.527243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5b3f0e1a-9e6a-4c56-ae13-c376a0e49fef None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:34.528462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5b3f0e1a-9e6a-4c56-ae13-c376a0e49fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:34.622194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 665/1321] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:34 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:34.660509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:34.662040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:34.762470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39d6f22-8336-44e4-86b1-970b935100fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:34.834116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:34.834758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:34.835038 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:34.835314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:34.836960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:34.844782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:34.943613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:34.945075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf4434-8a8a-41f0-811a-b63fc575bed8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:34.962821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 657/1322] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:38.311543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:38.312061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:38.312224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:38.314255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 666/1323] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:38.319202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3367-11e9-4bfb-be13-17d5ace08c87 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:38.319630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3367-11e9-4bfb-be13-17d5ace08c87 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:38.319753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df3367-11e9-4bfb-be13-17d5ace08c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:38.384232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3df3367-11e9-4bfb-be13-17d5ace08c87 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:38.385431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3df3367-11e9-4bfb-be13-17d5ace08c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:38.444776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:38.482938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 658/1324] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:38.519441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:38.521104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:38.632454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823d972-d7d8-4521-b2f9-f5501099f9b0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:38.645636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:38.711434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:38.712097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:38.712411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:38.712690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:38.714428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:38.829312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:38.830747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e30f18-889c-4ab0-9a5e-6515eb25424e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:38.848732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 667/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:40.926293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:40.926856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:40.926856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:40.928241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 659/1326] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:40.933296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf3198-70c3-4f48-8194-5916f3eea7a2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:40.933691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf3198-70c3-4f48-8194-5916f3eea7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:40.933855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf3198-70c3-4f48-8194-5916f3eea7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:40.979389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:40.998300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-81bf3198-70c3-4f48-8194-5916f3eea7a2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:40.998300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-81bf3198-70c3-4f48-8194-5916f3eea7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:41.095371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 668/1327] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:41.130841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:41.132467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:41.237422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0526b3ed-af82-432a-9678-b18d10635910 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:41.310662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:41.311319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:41.313025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:41.313025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:41.314227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:41.332892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:41.428252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:41.429688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133291ae-97a0-4536-b41c-b91916207d29 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:41.448525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 660/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:12:43.491518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:43.492059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:43.492059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:43.493504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 669/1329] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:43.499230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e6c2-24a1-4ec6-82db-111e170aaa2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:43.499781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e6c2-24a1-4ec6-82db-111e170aaa2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:43.499918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7e6c2-24a1-4ec6-82db-111e170aaa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:43.569338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07a7e6c2-24a1-4ec6-82db-111e170aaa2b None None] MFA Rules not processed for user `c6ae44ed6e014d21a3fad60503910b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:43.570517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07a7e6c2-24a1-4ec6-82db-111e170aaa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:43.635053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:43.667306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 661/1330] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:43.705078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:43.706629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:43.813953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf210584-b581-4f43-9179-fda941b1b38e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:43.834565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:43.888207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:43.889140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:43.889433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:43.889716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:43.891969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:44.001555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:44.003006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4516f91-63af-4c31-a0b5-9c816d7f36e5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:44.021993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 670/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:46.711603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:46.712275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:46.712275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:46.713588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 662/1332] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:46.718643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858a6d-ac26-4cf7-8e66-ee68442da8a1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:46.719066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858a6d-ac26-4cf7-8e66-ee68442da8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:46.719228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb858a6d-ac26-4cf7-8e66-ee68442da8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:46.780333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:46.782866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb858a6d-ac26-4cf7-8e66-ee68442da8a1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:46.784058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb858a6d-ac26-4cf7-8e66-ee68442da8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:46.878150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 671/1333] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:46.914243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:46.916050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:47.017384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb65c7-9036-4855-bce5-27013baa4fdb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:47.090284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:47.090931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:47.091213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:47.091487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:47.093783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:47.120238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:47.201245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:47.203224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed5257-1518-4cdb-8f52-dc9e38247669 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:47.221480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 663/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:49.256904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:49.257408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:49.257408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:49.258893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 672/1335] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:49.264193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b132-2043-4f9c-8ff5-61dcf7e2ab61 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:49.264592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b132-2043-4f9c-8ff5-61dcf7e2ab61 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:49.264764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781b132-2043-4f9c-8ff5-61dcf7e2ab61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:49.329108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0781b132-2043-4f9c-8ff5-61dcf7e2ab61 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:49.330293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0781b132-2043-4f9c-8ff5-61dcf7e2ab61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:49.402513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:49.424390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 664/1336] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:49.464045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:49.465659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:49.566331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550cac51-8409-4e94-b66f-d2c9c2152e78 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:49.592916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:49.636755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:49.637397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:49.637679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:49.637954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:49.639567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:49.744388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:49.746077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0826053e-733d-4d25-a10d-396226c18132 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:49.764710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 673/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:52.588404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:52.589017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:52.589017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:52.590378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 665/1338] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:52.596219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90464f8-b583-43f8-bc67-d5fd45dae019 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:52.596659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90464f8-b583-43f8-bc67-d5fd45dae019 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:52.596769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90464f8-b583-43f8-bc67-d5fd45dae019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:52.659857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b90464f8-b583-43f8-bc67-d5fd45dae019 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:52.661110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b90464f8-b583-43f8-bc67-d5fd45dae019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:52.669467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:52.756392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 674/1339] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:52.792725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:52.794241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:52.894994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fede59-9e64-4451-b94f-8ce401a7f3bf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:52.965074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:52.965714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:52.965994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:52.966266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:52.968418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:53.002485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:53.075597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:53.077064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49937c39-3863-4a0f-bb18-a754e77a8934 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:53.095709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 666/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:12:57.212782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:57.213271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:57.213375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:57.214770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 675/1341] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:12:57.220742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ab0-809b-408a-843e-895d7911622c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:57.221203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ab0-809b-408a-843e-895d7911622c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:57.221306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37904ab0-809b-408a-843e-895d7911622c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:57.291386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37904ab0-809b-408a-843e-895d7911622c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:12:57.292725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37904ab0-809b-408a-843e-895d7911622c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:57.386175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:57.405215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 667/1342] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:12:57.444365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:12:57.445909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:57.547718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a2666-a50e-4a8a-bd7b-b266d40e6500 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:12:57.585320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:12:57.621382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:12:57.622215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:12:57.622498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:12:57.622775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:12:57.625000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:12:57.732620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:12:57.734682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bdc2dc-7a2e-40a7-9a85-e0cabbfc7c55 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:12:57.753378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 676/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:00.720533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:00.721083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:00.721083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:00.722472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 668/1344] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:00.727796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c982e-13d2-4ec1-b0c4-6f1991e745f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:00.728205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c982e-13d2-4ec1-b0c4-6f1991e745f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:00.728392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c982e-13d2-4ec1-b0c4-6f1991e745f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:00.792395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0c8c982e-13d2-4ec1-b0c4-6f1991e745f7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:00.793590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0c8c982e-13d2-4ec1-b0c4-6f1991e745f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:00.811669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:00.896392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 677/1345] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:00.933634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:00.935243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:01.037650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47993ca2-e9e4-4489-bfce-8f6dacbd069a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:01.118019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:01.118669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:01.118953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:01.119229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:01.120907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:01.164724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:01.231163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:01.233010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fc1ac5-8744-43f7-999e-d38221605eb5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:01.253039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 669/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:05.449660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:05.450144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:05.450227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:05.456141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 678/1347] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:05.457534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e08a-a1a7-4481-81eb-49d01b2c4d33 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:05.457994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e08a-a1a7-4481-81eb-49d01b2c4d33 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:05.458108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7e08a-a1a7-4481-81eb-49d01b2c4d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:05.525865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8be7e08a-a1a7-4481-81eb-49d01b2c4d33 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:05.527069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8be7e08a-a1a7-4481-81eb-49d01b2c4d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:05.628530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:05.631643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 670/1348] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:13:05.669880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:05.671587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:05.779316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451b634f-33b6-4978-b9b2-63f7eae78203 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:05.830384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:05.856919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:05.857580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:05.857861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:05.858165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:05.859840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:05.973525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:05.975121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049c298-9de1-4fe1-be5b-f56573b4ad83 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:05.996500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 679/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:10.950612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e7f-152c-4e23-9c78-82dce492860c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:10.951469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e7f-152c-4e23-9c78-82dce492860c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:10.952452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2155e7f-152c-4e23-9c78-82dce492860c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:10.954362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 671/1350] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:13:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:10.959095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13ef4-b1a4-4ad5-8f9b-288b7550183d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:10.959508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13ef4-b1a4-4ad5-8f9b-288b7550183d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:10.959603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d13ef4-b1a4-4ad5-8f9b-288b7550183d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:11.044495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a3d13ef4-b1a4-4ad5-8f9b-288b7550183d None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:11.049165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a3d13ef4-b1a4-4ad5-8f9b-288b7550183d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:11.075626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:11.190197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 680/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:15.104110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea088-9fb6-46e0-a973-09bb592548fc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:15.104625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea088-9fb6-46e0-a973-09bb592548fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:15.104625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aea088-9fb6-46e0-a973-09bb592548fc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:15.106128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 672/1352] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:15.111759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd713e-d300-449c-9c0a-bd26edaf2e4b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:15.112239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd713e-d300-449c-9c0a-bd26edaf2e4b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:15.112561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd713e-d300-449c-9c0a-bd26edaf2e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:15.199981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b2dd713e-d300-449c-9c0a-bd26edaf2e4b None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:15.201375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b2dd713e-d300-449c-9c0a-bd26edaf2e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:15.274912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:15.313183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 681/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:13:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:16.779988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba390-7f0e-4e15-83d1-008940949f6e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:16.780977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba390-7f0e-4e15-83d1-008940949f6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:16.781338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aba390-7f0e-4e15-83d1-008940949f6e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:16.782806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 673/1354] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:16.788483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad05a-2e69-4d55-8d69-01c2c0ae576a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:16.788923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad05a-2e69-4d55-8d69-01c2c0ae576a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:16.789490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad05a-2e69-4d55-8d69-01c2c0ae576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:16.874886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-325ad05a-2e69-4d55-8d69-01c2c0ae576a None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:16.876130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-325ad05a-2e69-4d55-8d69-01c2c0ae576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:16.984065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 682/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:20.422516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e182-4134-49bb-b097-b030e90dc012 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:20.423043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e182-4134-49bb-b097-b030e90dc012 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:20.423043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c6e182-4134-49bb-b097-b030e90dc012 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:20.424388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 674/1356] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:20.429945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78416f-097f-4725-927b-74c741042f0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:20.430397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78416f-097f-4725-927b-74c741042f0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:20.430711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e78416f-097f-4725-927b-74c741042f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:20.470763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:20.511053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5e78416f-097f-4725-927b-74c741042f0c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:20.513031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5e78416f-097f-4725-927b-74c741042f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:20.624273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 683/1357] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:20.680366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:20.681056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:20.681495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:20.683291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 675/1358] 10.222.0.33 () {54 vars in 961 bytes} [Tue Jul 12 18:13:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:20.692908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47529f3-10ad-4945-be5c-07a031ffa5a4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:20.693542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47529f3-10ad-4945-be5c-07a031ffa5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:20.694136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47529f3-10ad-4945-be5c-07a031ffa5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:20.775032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c47529f3-10ad-4945-be5c-07a031ffa5a4 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:20.776360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c47529f3-10ad-4945-be5c-07a031ffa5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:20.830049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:20.903997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 684/1359] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Jul 12 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:20.913872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:20.915647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:21.118336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfd3d0-f94c-414a-bd05-0953174d29bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:21.211705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:21.240648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:21.241269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:21.241544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:21.241827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:21.243486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:21.361214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:21.362839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba48ec-468e-465c-9620-c7af0a038d9d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:21.383254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 676/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:23.637224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:23.637776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:23.637776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:23.643741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 685/1361] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:23.645488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0958e-fa8e-4c59-b184-3d06c2bbba42 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:23.645955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0958e-fa8e-4c59-b184-3d06c2bbba42 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:23.646046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0958e-fa8e-4c59-b184-3d06c2bbba42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:23.724741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46c0958e-fa8e-4c59-b184-3d06c2bbba42 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:23.726075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46c0958e-fa8e-4c59-b184-3d06c2bbba42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:23.768076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:23.835184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 677/1362] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:23.879385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:23.881095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:24.051993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaebf-19ee-413f-83b0-af6165ee2b44 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:24.063502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:24.219472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:24.220506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:24.221009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:24.221488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:24.223534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:24.320379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:24.322400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5df4da-37ea-4166-994c-eccb6c8a7b69 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:24.342715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 686/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:26.890782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46c87-6712-4927-b037-c6b994702660 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:26.891352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46c87-6712-4927-b037-c6b994702660 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:26.891602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe46c87-6712-4927-b037-c6b994702660 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:26.893143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 678/1364] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:26.898677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe89b-a478-4c09-baf0-d2935ef81449 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:26.899477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe89b-a478-4c09-baf0-d2935ef81449 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:26.899796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72fe89b-a478-4c09-baf0-d2935ef81449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:26.918462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:26.983010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f72fe89b-a478-4c09-baf0-d2935ef81449 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:26.984462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f72fe89b-a478-4c09-baf0-d2935ef81449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:27.088196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 687/1365] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:27.134555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:27.135028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:27.135433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:27.137253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 679/1366] 10.222.0.33 () {54 vars in 961 bytes} [Tue Jul 12 18:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:27.143228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46944ae-d78f-4be6-a52b-94a458e31373 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:27.149465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46944ae-d78f-4be6-a52b-94a458e31373 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:27.149465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46944ae-d78f-4be6-a52b-94a458e31373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:27.239460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d46944ae-d78f-4be6-a52b-94a458e31373 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:27.240829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d46944ae-d78f-4be6-a52b-94a458e31373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:27.285821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:27.374060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 688/1367] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Jul 12 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:27.382775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:27.384479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:27.539462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc95e8-7120-44bb-81f1-e76cedff67cf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:27.562253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:27.661938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:27.662689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:27.663070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:27.663445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:27.665485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:27.757889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:27.759680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaae97e-fbd8-47e2-b1df-fb0d6711a6d0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:27.779716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 680/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:28.533158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded216-3eae-464c-97b2-3759cb9d320d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:28.533721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded216-3eae-464c-97b2-3759cb9d320d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:28.533721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aded216-3eae-464c-97b2-3759cb9d320d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:28.535282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 689/1369] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:28.540467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48036-5c83-430c-975c-f7125a651534 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:28.540930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48036-5c83-430c-975c-f7125a651534 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:28.541048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb48036-5c83-430c-975c-f7125a651534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:28.573243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:28.608556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ecb48036-5c83-430c-975c-f7125a651534 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:28.610383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecb48036-5c83-430c-975c-f7125a651534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:28.711236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 681/1370] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:29.015226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:29.015519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:29.015802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:29.017344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 690/1371] 10.222.0.33 () {54 vars in 963 bytes} [Tue Jul 12 18:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:29.022002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b66b9-f4da-4242-b4cd-3a85595272d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:29.022295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b66b9-f4da-4242-b4cd-3a85595272d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:29.022572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b66b9-f4da-4242-b4cd-3a85595272d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:29.104418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-378b66b9-f4da-4242-b4cd-3a85595272d6 None None] MFA Rules not processed for user `c342400998514fe5beb96566fba15918`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:29.105550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-378b66b9-f4da-4242-b4cd-3a85595272d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:29.154667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:29.186391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 682/1372] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Jul 12 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:29.193725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:29.195275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:29.305538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278a54e-a28a-45ba-a4cd-005dca8b8bab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:29.346560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:29.380150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:29.380817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:29.381103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:29.381380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:29.383008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:29.498469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:29.499910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a8dd50-b224-4f03-a889-8ec12772e727 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:29.519296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 691/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:30.023000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:30.023583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:30.023583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:30.025120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 683/1374] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:30.030084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7bc0-39b3-4b7a-a4b2-d08fe92521ed None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:30.030461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7bc0-39b3-4b7a-a4b2-d08fe92521ed None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:30.030667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a7bc0-39b3-4b7a-a4b2-d08fe92521ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:30.103376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-237a7bc0-39b3-4b7a-a4b2-d08fe92521ed None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:30.104800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-237a7bc0-39b3-4b7a-a4b2-d08fe92521ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:30.127972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:30.211495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 692/1375] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:30.256039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:30.257581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:30.404471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3a9d2-ad61-4320-bfe5-9ab040e1a349 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:30.455608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:30.516872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:30.517511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:30.517817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:30.518084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:30.519707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:30.608515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:30.610102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc200d-351f-48e6-846e-f63a7804d943 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:30.628168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 684/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:32.770868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:32.771392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:32.771392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:32.772774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 693/1377] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:32.777972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97cf2-75da-471a-8f7c-7959874f8c82 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:32.778372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97cf2-75da-471a-8f7c-7959874f8c82 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:32.778537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a97cf2-75da-471a-8f7c-7959874f8c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:32.846658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e7a97cf2-75da-471a-8f7c-7959874f8c82 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:32.847873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7a97cf2-75da-471a-8f7c-7959874f8c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:32.854550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:32.945266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 685/1378] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:32.989653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:32.991258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:33.182830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22a6a4-30ff-47d9-95c3-950aef657b22 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:33.199488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:33.320086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:33.320767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:33.321180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:33.321471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:33.323120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:33.420087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:33.421674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e959a7-fa70-4201-9849-3978beb41b9e service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:33.440583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 694/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:35.634812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:35.635266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:35.635358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:35.636791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 686/1380] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:35.642777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256b8c-da6f-4b57-ab52-2ec773fedaa7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:35.643169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256b8c-da6f-4b57-ab52-2ec773fedaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:35.643340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73256b8c-da6f-4b57-ab52-2ec773fedaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:35.653658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:35.709342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-73256b8c-da6f-4b57-ab52-2ec773fedaa7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:35.710528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-73256b8c-da6f-4b57-ab52-2ec773fedaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:35.806274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 695/1381] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:13:35.851216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:35.852898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:35.999856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:36.006924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4229d2f-56e6-4009-b202-eb83ae69b575 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:36.123745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:36.124422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:36.124705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:36.124979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:36.126668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:36.227719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:36.229473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba113a-a2b5-41c4-8faa-c5fcdb82d77d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:36.242860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:36.253110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 687/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:38.523293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:38.523943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:38.523943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:38.525397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 696/1383] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:38.531379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9f5e-a800-45a0-b5c1-9b15a8b66d55 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:38.531890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9f5e-a800-45a0-b5c1-9b15a8b66d55 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:38.532067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f9f5e-a800-45a0-b5c1-9b15a8b66d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:38.597587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-725f9f5e-a800-45a0-b5c1-9b15a8b66d55 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:38.598809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-725f9f5e-a800-45a0-b5c1-9b15a8b66d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:38.700378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 688/1384] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:38.741479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:38.743043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:38.845346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:38.923176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df38ea29-f597-43cf-a8ee-94f2f8567b8b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:39.043394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:39.044051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:39.044867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:39.045145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:39.046802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:39.096581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:39.138423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:39.140047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39516a-6c0a-4e73-b156-ebc3c9d6bf38 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:39.158197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 697/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:13:41.253802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:41.254478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:41.254478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:41.255786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 689/1386] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:41.261116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b470d-eb5a-4db9-ac87-d2f36584735c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:41.261544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b470d-eb5a-4db9-ac87-d2f36584735c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:41.261676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b470d-eb5a-4db9-ac87-d2f36584735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:41.327894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-671b470d-eb5a-4db9-ac87-d2f36584735c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:41.329137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-671b470d-eb5a-4db9-ac87-d2f36584735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:41.445918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 698/1387] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:41.491055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:41.492622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:41.572956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:41.642702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae7dd5-f59c-409d-82e4-6af49648b01f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:41.784699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:41.785495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:41.785866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:41.786227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:41.788450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:41.839318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:41.918247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:41.921378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b9f4-0ea8-4e93-8162-cf00988f6d59 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:41.941173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 690/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:44.111372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:44.111864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:44.111864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:44.113289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 699/1389] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:44.118406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae07a-5f9d-42bf-8527-880229270784 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:44.118813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae07a-5f9d-42bf-8527-880229270784 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:44.118964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae07a-5f9d-42bf-8527-880229270784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:44.183284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-192ae07a-5f9d-42bf-8527-880229270784 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:44.185006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-192ae07a-5f9d-42bf-8527-880229270784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:44.284536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 691/1390] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:44.328526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:44.330051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:44.360536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:44.474722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc32c35-f66b-4aef-b92c-24ef299f5dce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:44.575555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:44.586845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:44.587500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:44.587791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:44.588071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:44.589746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:44.678977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:44.680626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b5d7b-2353-4b51-bf3f-6adb300e66d1 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:44.698433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 700/1391] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:45.181898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10369a-06b1-4a91-a22c-229535db72ba None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.182436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10369a-06b1-4a91-a22c-229535db72ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.182558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f10369a-06b1-4a91-a22c-229535db72ba None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.183995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 692/1392] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:45.189195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c573a2-616b-4154-8c01-71fa79abac4a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.189626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c573a2-616b-4154-8c01-71fa79abac4a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.189755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c573a2-616b-4154-8c01-71fa79abac4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.253949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-55c573a2-616b-4154-8c01-71fa79abac4a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:45.255143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55c573a2-616b-4154-8c01-71fa79abac4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.313463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.352134 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 701/1393] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:45.407232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.407522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.407798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.409199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 693/1394] 10.222.0.33 () {54 vars in 962 bytes} [Tue Jul 12 18:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:45.414267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f08c-0fd2-4f4d-aa4f-dbee3624f8f6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.414635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f08c-0fd2-4f4d-aa4f-dbee3624f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.415367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656f08c-0fd2-4f4d-aa4f-dbee3624f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.490361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7656f08c-0fd2-4f4d-aa4f-dbee3624f8f6 None None] MFA Rules not processed for user `8bc8f7da375441049d3975f1b80951a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:45.491474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7656f08c-0fd2-4f4d-aa4f-dbee3624f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.567199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 702/1395] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Jul 12 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:13:45.574876 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:45.576985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.590912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.681576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50101cd7-e6b5-4844-aabe-f87c03642aaf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:45.754694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:45.755315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:45.755600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:45.755870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:45.757531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:45.825781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:45.866711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:45.868175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d9d5-9787-47d1-8b92-f4e7e8f8e918 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:45.886752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 694/1396] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:46.723552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53225e-9ce7-43c0-9fd4-268d436c76b2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:46.724068 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53225e-9ce7-43c0-9fd4-268d436c76b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:46.724192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd53225e-9ce7-43c0-9fd4-268d436c76b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:46.790587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fd53225e-9ce7-43c0-9fd4-268d436c76b2 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:46.791818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fd53225e-9ce7-43c0-9fd4-268d436c76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:46.802738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:46.891144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778515-b9b4-4412-82ff-9d8eafe56fc2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:46.891697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778515-b9b4-4412-82ff-9d8eafe56fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:46.891697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d778515-b9b4-4412-82ff-9d8eafe56fc2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:46.893183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 695/1397] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:46.900143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 703/1398] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:46.900261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:46.900261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:46.900261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:46.938970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bbdf-546c-40ef-a3f3-9b9170200380 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:46.939264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bbdf-546c-40ef-a3f3-9b9170200380 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:46.939547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3bbdf-546c-40ef-a3f3-9b9170200380 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:46.941130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 704/1399] 10.222.0.33 () {54 vars in 942 bytes} [Tue Jul 12 18:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:13:46.947134 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:46.947495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:46.947874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:46.968940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:46.970146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:47.023540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] MFA Rules not processed for user `57d606342e46439f8f1274278438fb1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:47.024760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:47.070730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 696/1400] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:47.108319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:47.115575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:47.116964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:47.131525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 705/1401] 10.222.0.33 () {58 vars in 1039 bytes} [Tue Jul 12 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:13:47.141598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:47.145152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:47.151211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0818422-a36b-4cab-94eb-3da5fa8391cc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:47.233958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21d526-2c16-4d94-8788-1dfe39afcb10 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:47.260419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:47.261076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:47.261365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:47.261641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:47.263976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:47.350311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:47.351139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:47.351785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:47.351934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198267c5-1a8d-471e-94dd-cac1e63dd499 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:47.352063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:47.352362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:47.353992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:47.360109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 706/1402] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:13:47.374737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:47.446355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:47.447963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013c4f6-0787-4ac5-9b69-78c725ab26a2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:47.466933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 697/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:49.654974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.655540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.655540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.657224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 707/1404] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:49.662247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163330f-1211-465d-8b40-d7c4e0cc259d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:49.662693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163330f-1211-465d-8b40-d7c4e0cc259d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:49.662812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a163330f-1211-465d-8b40-d7c4e0cc259d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:49.734820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a163330f-1211-465d-8b40-d7c4e0cc259d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:49.736040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a163330f-1211-465d-8b40-d7c4e0cc259d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:49.835641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:49.842893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 698/1405] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:49.889076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:49.890810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:49.901594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.055246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b877e-bfdd-44a8-8e3c-f81cc6d55690 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:50.144737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:50.179557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:50.180257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:50.180543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:50.180820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:50.182488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:50.282923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:50.284534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b92a3e-6802-4340-8f19-a7379d495ac0 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:50.311465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 708/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:13:53.450764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:53.451705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:53.451981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:53.456155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 699/1407] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:13:53.459116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c178-ce3d-4e99-ac8d-bcca0a628a0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:53.459552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c178-ce3d-4e99-ac8d-bcca0a628a0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:53.459746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b81c178-ce3d-4e99-ac8d-bcca0a628a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:53.539051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4b81c178-ce3d-4e99-ac8d-bcca0a628a0c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:13:53.540873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4b81c178-ce3d-4e99-ac8d-bcca0a628a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:53.596730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:53.657861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 709/1408] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:13:53.706586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:13:53.708348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:53.880898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6a5b-edd4-43a8-97c1-84286dff5445 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:13:53.959456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:13:54.014789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:13:54.015451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:13:54.015733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:13:54.016004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:13:54.017711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:13:54.112190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:13:54.113810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19158b55-1eaa-4497-982f-e9a614a569dd service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:13:54.133166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 700/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:03.655360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=23 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:04.130232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=64 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.503440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374fe6d-6f33-4f01-9a2b-6805c989a98f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.503982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374fe6d-6f33-4f01-9a2b-6805c989a98f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.503982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374fe6d-6f33-4f01-9a2b-6805c989a98f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.505335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 710/1410] 10.222.0.33 () {54 vars in 918 bytes} [Tue Jul 12 18:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:10.510422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76888d37-12e5-4cce-a65c-3eb1a06a7363 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.510828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76888d37-12e5-4cce-a65c-3eb1a06a7363 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.510988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76888d37-12e5-4cce-a65c-3eb1a06a7363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.584028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76888d37-12e5-4cce-a65c-3eb1a06a7363 None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:10.585265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76888d37-12e5-4cce-a65c-3eb1a06a7363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:10.688427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 701/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jul 12 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:10.702383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120383-3924-4c74-b0c8-1337360b7c3b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.702674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120383-3924-4c74-b0c8-1337360b7c3b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.702950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a120383-3924-4c74-b0c8-1337360b7c3b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.704390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 711/1412] 10.222.0.33 () {54 vars in 918 bytes} [Tue Jul 12 18:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:10.709105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb1fc-d5af-4f57-9960-befbf22dcfeb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:10.709396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb1fc-d5af-4f57-9960-befbf22dcfeb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:10.709676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acdb1fc-d5af-4f57-9960-befbf22dcfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:10.778231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:10.781248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9acdb1fc-d5af-4f57-9960-befbf22dcfeb None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:10.782438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9acdb1fc-d5af-4f57-9960-befbf22dcfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:10.899262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 702/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jul 12 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:13.375065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.375633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.375633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.377036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:13.382129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6799b-28aa-466a-9ad0-b6e2212b4fcb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.382553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6799b-28aa-466a-9ad0-b6e2212b4fcb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.382681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6799b-28aa-466a-9ad0-b6e2212b4fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.445330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76e6799b-28aa-466a-9ad0-b6e2212b4fcb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:13.446545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76e6799b-28aa-466a-9ad0-b6e2212b4fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:13.500906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.544764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:13.587349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:13.588884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:13.730950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865e334-9ae2-4f53-923b-a3aa160df78b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:13.801258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:13.842169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:13.842820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:13.843106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:13.843386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:13.845136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:13.931472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:13.933116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d96b34d-d360-4e78-8a0d-107a7728c057 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:13.951799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 713/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:14.840674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.841151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.841247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.842615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:14.847941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf42f-7369-4e95-aa76-560d11356cb2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:14.848397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf42f-7369-4e95-aa76-560d11356cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:14.848544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941bf42f-7369-4e95-aa76-560d11356cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:14.925191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-941bf42f-7369-4e95-aa76-560d11356cb2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:14.926402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-941bf42f-7369-4e95-aa76-560d11356cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:14.953277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.024562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:15.172220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:15.173679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:15.315956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84369-4b1f-43c9-9227-819a49b07558 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:15.354803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:15.426742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:15.427299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:15.427578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:15.427847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:15.429517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:15.516971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:15.518581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed943b-9f81-4525-9041-16c462f7d587 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:15.536915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 705/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:16.409892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.410494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.410494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.411820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:16.416972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827125-45b5-401c-960b-a9fd0c3fbb60 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.417394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827125-45b5-401c-960b-a9fd0c3fbb60 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.417661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e827125-45b5-401c-960b-a9fd0c3fbb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.470284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:16.492302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e827125-45b5-401c-960b-a9fd0c3fbb60 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:16.493514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e827125-45b5-401c-960b-a9fd0c3fbb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:16.587890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:16.738035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:16.739499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:16.884541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd247ac-b43e-4ec6-8b72-4f67c09e1c6a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:16.896662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:16.994865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:16.995440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:16.995790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:16.996067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:16.997729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:17.083655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:17.085260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bbe139-5ed1-44e9-af51-700a95f8a482 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:17.103228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 716/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:17.958124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.958706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.958706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.960065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:17.965107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833551-f511-4186-b317-52ece69e748f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:17.965539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833551-f511-4186-b317-52ece69e748f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:17.965680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9833551-f511-4186-b317-52ece69e748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:17.984262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.039786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e9833551-f511-4186-b317-52ece69e748f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:18.041290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9833551-f511-4186-b317-52ece69e748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:18.136677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:18.284789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:18.286352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:18.394204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.429945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d90e94-70a8-4ccb-b216-f541018d96c8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:18.540836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:18.541474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:18.541755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:18.542027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:18.544308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:18.617277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:18.631237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:18.632862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83477af-8a56-45a2-a8b5-47a2b7e2619a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:18.651303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 708/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:19.507250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752235a-4389-49db-84bc-1013359cb034 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.507820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752235a-4389-49db-84bc-1013359cb034 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.507820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752235a-4389-49db-84bc-1013359cb034 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.509221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:19.514793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ef81-1754-493e-ab13-e2192cc0cd50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:19.515237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ef81-1754-493e-ab13-e2192cc0cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:19.515344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577ef81-1754-493e-ab13-e2192cc0cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:19.588757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8577ef81-1754-493e-ab13-e2192cc0cd50 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:19.590487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8577ef81-1754-493e-ab13-e2192cc0cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:19.683989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:19.832872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752235a-4389-49db-84bc-1013359cb034 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:19.834419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c752235a-4389-49db-84bc-1013359cb034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:19.917021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:19.977022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752235a-4389-49db-84bc-1013359cb034 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:20.087272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:20.087857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:20.088161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:20.088441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:20.090113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:20.137205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:20.177682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:20.179287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf399886-e4e1-4951-be71-5840333c734c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:20.197355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 719/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:21.047306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.047858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.047858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.049316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:21.054127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dc04-47cd-41f4-a466-4403b9410173 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.054556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dc04-47cd-41f4-a466-4403b9410173 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.054744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22dc04-47cd-41f4-a466-4403b9410173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.127649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c22dc04-47cd-41f4-a466-4403b9410173 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:21.128805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c22dc04-47cd-41f4-a466-4403b9410173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:21.224700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:21.373325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:21.374864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:21.434660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.538285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ebcdb-c87a-44e7-bb6f-045969994c8c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:21.654151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:21.654725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:21.655007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:21.655284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:21.656953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:21.663680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:21.746348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:21.748032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052ba0b-c9a1-426c-8aaa-96dc2379df46 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:21.765649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 711/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:22.614123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.614726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.614726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.616047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:22.620871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae93-10b3-4df5-a047-af5fe4689422 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:22.621322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae93-10b3-4df5-a047-af5fe4689422 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:22.621430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffae93-10b3-4df5-a047-af5fe4689422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:22.693616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-39ffae93-10b3-4df5-a047-af5fe4689422 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:22.694816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-39ffae93-10b3-4df5-a047-af5fe4689422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:22.762575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:22.791318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:22.940250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:22.941832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:22.959562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.085406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f73489-ca94-45a1-bed9-3a5e1b68c561 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:23.169925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:23.195797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:23.196478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:23.196772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:23.197041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:23.199231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:23.285678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:23.287186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4410e160-e20a-4727-ab47-eed8f7c30a96 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:23.305376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 722/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:24.163401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.163899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.164014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.165694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:24.170710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2d6b-806e-4ea8-b87a-7dddaff19e25 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.172155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2d6b-806e-4ea8-b87a-7dddaff19e25 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.172155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f2d6b-806e-4ea8-b87a-7dddaff19e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.243903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-296f2d6b-806e-4ea8-b87a-7dddaff19e25 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:24.245213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-296f2d6b-806e-4ea8-b87a-7dddaff19e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.286713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.346655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:24.495074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:24.497241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.645017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0bb71-e789-4c64-8b9a-245dc8fb70ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:24.698076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:24.755589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:24.756259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:24.756539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:24.756805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:24.758425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:24.849107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:24.850716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc57e5-4197-45e9-bc9c-0f01186e765d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:24.868443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 714/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:25.763960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.764571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.764571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.765911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:25.770688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe83a-660a-4b58-b723-ffaba8f806b5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:25.771125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe83a-660a-4b58-b723-ffaba8f806b5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:25.771222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffe83a-660a-4b58-b723-ffaba8f806b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:25.844610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4bffe83a-660a-4b58-b723-ffaba8f806b5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:25.845802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4bffe83a-660a-4b58-b723-ffaba8f806b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:25.847777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:25.942959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:26.093952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:26.095466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:26.245113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3632790d-3759-496c-ba89-a70f149d64a8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:26.272847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:26.361777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:26.362416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:26.362703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:26.362980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:26.364710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:26.454240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:26.455845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112f46c-2ede-49b9-99b2-92945a251f10 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:26.473826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 725/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:28.402756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.403325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.403325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.404817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:28.410213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff37d4-9375-4793-9a3e-832931a66eff None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.410643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff37d4-9375-4793-9a3e-832931a66eff None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.410780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff37d4-9375-4793-9a3e-832931a66eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.450451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.475182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-52ff37d4-9375-4793-9a3e-832931a66eff None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:28.476409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-52ff37d4-9375-4793-9a3e-832931a66eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:28.583475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:14:28.621558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:28.623068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:28.723990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb81e2f-3729-4dea-86f5-1dbe21e95d76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:28.755257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:28.797204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:28.797851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:28.798137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:28.798414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:28.800054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:28.907440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:28.908916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2efdeb-5f82-47ea-a01f-bb77321c4d9f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:28.928731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 717/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:31.095008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.095527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.095527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.096896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:31.102300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f867-b3d3-4d6f-95a6-36b9203487e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.102704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f867-b3d3-4d6f-95a6-36b9203487e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.102861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f867-b3d3-4d6f-95a6-36b9203487e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.167043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0a0f867-b3d3-4d6f-95a6-36b9203487e9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:31.168290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0a0f867-b3d3-4d6f-95a6-36b9203487e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:31.180663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.266413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:31.303910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:31.305604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:31.415090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262d554-a148-488f-96ca-1d628a4fdb12 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:31.428080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:31.491259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:31.491916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:31.492240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:31.492521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:31.494222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:31.602001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:31.603441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a20ce-09b2-4b5f-a318-34fbbc78d8b4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:31.622332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 728/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:34.047978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.048448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.048578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.049983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:34.055165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3b43-bccb-4ffe-ae73-604cbe02f8e2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.055595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3b43-bccb-4ffe-ae73-604cbe02f8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.055731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a3b43-bccb-4ffe-ae73-604cbe02f8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.102090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.119049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1c4a3b43-bccb-4ffe-ae73-604cbe02f8e2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:34.120796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1c4a3b43-bccb-4ffe-ae73-604cbe02f8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:34.216109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:34.253989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:34.255514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:34.357466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ae333-ca27-4284-94f3-ea315863e5f0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:34.396961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:34.429628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:34.430600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:34.430887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:34.431180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:34.433362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:34.541281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:34.543246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942047e-758e-487a-a2f6-7c49207e231a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:34.562103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 720/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:36.702708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.703268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.703268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.704699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:36.709869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a92f-6424-4b5a-b917-3b51eb25932d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:36.710249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a92f-6424-4b5a-b917-3b51eb25932d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:36.710434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b2a92f-6424-4b5a-b917-3b51eb25932d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:36.774999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-00b2a92f-6424-4b5a-b917-3b51eb25932d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:36.776829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00b2a92f-6424-4b5a-b917-3b51eb25932d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:36.797709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:36.874503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:36.913600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:36.915409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:37.016594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22cc38-d1d6-4f84-b486-25230900ec4d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:37.036328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:37.090573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:37.091222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:37.091511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:37.091790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:37.093468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:37.200842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:37.202285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8541ced-22dc-4b0f-bbef-c5db762c7987 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:37.219934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 731/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:39.295374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.295907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.295907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.297292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:39.302536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6cfb-a328-4dee-be58-51c090230cb4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.302943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6cfb-a328-4dee-be58-51c090230cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.303089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db6cfb-a328-4dee-be58-51c090230cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.363229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:39.365832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c7db6cfb-a328-4dee-be58-51c090230cb4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:39.367018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7db6cfb-a328-4dee-be58-51c090230cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:39.461681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:39.499195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:39.501103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:39.602401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa03919-46bd-4dd5-8364-72a3e8f1709d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:39.649967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:39.674277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:39.674921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:39.675202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:39.675476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:39.677145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:39.784371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:39.785832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e61dce-ed71-41c6-bac5-100319735806 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:39.804733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 723/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:41.964744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.965324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.965324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:41.966667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:41.971840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4275-89fc-4671-91c1-9755f6a302f7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:41.972306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4275-89fc-4671-91c1-9755f6a302f7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:41.972433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b4275-89fc-4671-91c1-9755f6a302f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.039525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f39b4275-89fc-4671-91c1-9755f6a302f7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:42.041024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f39b4275-89fc-4671-91c1-9755f6a302f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:42.070093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.135123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:42.172915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:42.174480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:42.276424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576fce1-32e1-41bd-bd1f-dbd3b2cae40c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:42.305325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:42.351177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:42.351748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:42.352031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:42.352341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:42.354585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:42.583079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:42.584551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d87608-6530-4c11-a288-642158cc8c1b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:42.603562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 734/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:44.680498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.681085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.681085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.682488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:14:44.687715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e5f9-4c52-41a8-ace6-02a1072c6c29 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:44.688097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e5f9-4c52-41a8-ace6-02a1072c6c29 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:44.688316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da85e5f9-4c52-41a8-ace6-02a1072c6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:44.750903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-da85e5f9-4c52-41a8-ace6-02a1072c6c29 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:44.752098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da85e5f9-4c52-41a8-ace6-02a1072c6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:44.760377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:44.847741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:44.885041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:44.886561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:44.987809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25415cb8-cc0d-4573-8cb6-e20964888dc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:45.042573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:45.060614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:45.061264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:45.061549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:45.061825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:45.063465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:45.170117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:45.171551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b2548-626a-4f7f-af43-fb0676ca48c5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:45.193354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 726/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:47.240110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:47.240692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:47.240692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:47.242058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:47.247973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df9ae-b3ca-42a1-911b-aab388c701ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:47.248395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df9ae-b3ca-42a1-911b-aab388c701ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:47.248568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545df9ae-b3ca-42a1-911b-aab388c701ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:47.312280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-545df9ae-b3ca-42a1-911b-aab388c701ca None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:47.313485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-545df9ae-b3ca-42a1-911b-aab388c701ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:47.352552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:47.409996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:47.447425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:47.449003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:47.550085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109bc8d-788d-4a35-ae56-ef28ea9b2a17 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:47.586556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:47.622356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:47.623022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:47.623305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:47.623581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:47.625270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:47.731732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:47.733118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7e11-e8dd-4f2f-81dd-fa51f5453ea3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:47.751914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 737/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:49.779406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.779950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.779950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.781409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:49.786687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf6c8-b9ad-4979-93b9-216726bda673 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:49.787090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf6c8-b9ad-4979-93b9-216726bda673 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:49.787253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf6c8-b9ad-4979-93b9-216726bda673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:49.851429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2fedf6c8-b9ad-4979-93b9-216726bda673 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:49.852657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2fedf6c8-b9ad-4979-93b9-216726bda673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:49.870589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:49.947246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:49.983394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:49.984988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:50.087769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3bee28-d833-4eab-9f2f-946819fefdcb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:50.152258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:50.158765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:50.162619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:50.162619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:50.162619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:50.162619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:50.268086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:50.269565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ec4b9-113a-4b23-8e45-bdf2b8a279cf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:50.287289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 729/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:14:52.318594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:52.319145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:52.319145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:52.320561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:14:52.325837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bafe9-8e63-4659-b445-c5c0ad5e972a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:52.326231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bafe9-8e63-4659-b445-c5c0ad5e972a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:52.326388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14bafe9-8e63-4659-b445-c5c0ad5e972a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:52.389674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d14bafe9-8e63-4659-b445-c5c0ad5e972a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:14:52.390870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d14bafe9-8e63-4659-b445-c5c0ad5e972a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:52.440467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:52.490373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:14:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:14:52.527450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:14:52.529058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:52.628070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eae253-553a-4a97-a48d-90b0dab27fad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:14:52.676167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:14:52.706532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:14:52.707175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:14:52.707734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:14:52.708080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:14:52.710356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:14:52.814775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:14:52.816237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bfab2-75db-46c4-a99b-2b9846db5c2e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:14:52.834877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 740/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:02.619708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=22 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:02.832777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=66 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.386916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb27-0347-4a7a-8129-7e70f2bc4829 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.387503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb27-0347-4a7a-8129-7e70f2bc4829 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.387503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1fb27-0347-4a7a-8129-7e70f2bc4829 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.388877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 731/1471] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:12.394139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d88a1-2413-4140-b133-2b6ae057c358 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.394543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d88a1-2413-4140-b133-2b6ae057c358 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.394705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4d88a1-2413-4140-b133-2b6ae057c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.460583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0d4d88a1-2413-4140-b133-2b6ae057c358 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:12.461829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0d4d88a1-2413-4140-b133-2b6ae057c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:12.561356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 741/1472] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:12.644015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.644343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.644641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.646089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 732/1473] 10.222.0.33 () {54 vars in 962 bytes} [Tue Jul 12 18:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:12.651153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dc19-afee-4604-a966-9723bbaa9907 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.651450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dc19-afee-4604-a966-9723bbaa9907 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.651734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074dc19-afee-4604-a966-9723bbaa9907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.724244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b074dc19-afee-4604-a966-9723bbaa9907 None None] MFA Rules not processed for user `8bc8f7da375441049d3975f1b80951a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:12.725464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b074dc19-afee-4604-a966-9723bbaa9907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:12.746341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:12.800792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 742/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Tue Jul 12 18:15:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:12.808956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:12.810486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:12.918878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e226ec9-6b11-4e12-89f5-1b9da3e112f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:12.990094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:12.990736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:12.991018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:12.991295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:12.992968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:13.045879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:13.100219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:13.101647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a33edc-427f-4d36-9840-30ea705dbb39 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:13.120040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 733/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:15.224225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.224764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.224764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.226116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 743/1476] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:15.231311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7606-fcbb-4f7d-a9c6-4727e00e1953 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.231728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7606-fcbb-4f7d-a9c6-4727e00e1953 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.231837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c7606-fcbb-4f7d-a9c6-4727e00e1953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.294443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cf3c7606-fcbb-4f7d-a9c6-4727e00e1953 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:15.295619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf3c7606-fcbb-4f7d-a9c6-4727e00e1953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:15.389710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 734/1477] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:15.412820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:15.414340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:15.537507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c7c102-bea1-4774-8c90-4901586b3fd2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:15.588095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:15.633219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:15.634494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:15.634778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:15.635070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:15.635780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:15.637604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:15:15.637604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:15:15.637604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:15:15.638725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219ad9e-1b99-4c0b-9829-1d4e3ba0b843 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:15.657487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 744/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Tue Jul 12 18:15:15 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:15:17.694620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.695259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.695548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.697397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 735/1479] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:17.702610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3275a8-9d11-4dee-8b4c-81e1498869e3 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:17.703036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3275a8-9d11-4dee-8b4c-81e1498869e3 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:17.703168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3275a8-9d11-4dee-8b4c-81e1498869e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:17.767107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5f3275a8-9d11-4dee-8b4c-81e1498869e3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:17.768322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5f3275a8-9d11-4dee-8b4c-81e1498869e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:17.862648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 745/1480] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:17.904787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:17.906298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:17.916712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.052130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df196665-50f0-482d-b623-9743f1ab2d17 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:18.129853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:18.162003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:18.162653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:18.162942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:18.163214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:18.165858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:18.252699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:18.254293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461792d2-4ac6-471a-83dd-13d36a4e99ae service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:18.272385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 736/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:20.473027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.473566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.473687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.474986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 746/1482] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:20.480729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799c45-a995-4504-abf6-b84370dd3014 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.481162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799c45-a995-4504-abf6-b84370dd3014 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.481293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799c45-a995-4504-abf6-b84370dd3014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.544934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e799c45-a995-4504-abf6-b84370dd3014 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:20.546126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e799c45-a995-4504-abf6-b84370dd3014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:20.592198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.641157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 737/1483] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:20.678474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:20.680095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:20.703245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.782052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a6370-5a5d-4b7a-ae05-4efd2b579450 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:20.854828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:20.855486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:20.855776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:20.856053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:20.857737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:20.931337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:20.968354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:20.969867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978294a-911f-4728-bdf4-aca5e8776417 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:20.988205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 747/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:23.044474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.044908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.045031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.046510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 738/1485] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:23.051586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc7fb-5acb-47fe-bf0e-7e18c54f188c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.052029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc7fb-5acb-47fe-bf0e-7e18c54f188c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.052183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fc7fb-5acb-47fe-bf0e-7e18c54f188c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.114918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-811fc7fb-5acb-47fe-bf0e-7e18c54f188c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:23.116036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-811fc7fb-5acb-47fe-bf0e-7e18c54f188c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:23.210904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 748/1486] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:23.248823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:23.250384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:23.357889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ffc49-797f-4910-a031-a7923c920dc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:23.427751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:23.429497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:23.430139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:23.430946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:23.431228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:23.432886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:23.540439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:23.541903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397cac2-7f50-4707-ad9d-3b371ec1f061 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:23.560496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 739/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:25.667613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.668246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.668246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.669635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 749/1488] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:15:25.674808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566711d2-395e-4d6b-9eb0-9846dcb72f72 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:25.675235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566711d2-395e-4d6b-9eb0-9846dcb72f72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:25.675369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566711d2-395e-4d6b-9eb0-9846dcb72f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:25.738262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-566711d2-395e-4d6b-9eb0-9846dcb72f72 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:25.739450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-566711d2-395e-4d6b-9eb0-9846dcb72f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:25.791718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.835882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 740/1489] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:25.877281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:25.878822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:25.914315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:25.981336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e609ebf-5b82-488f-804c-8c37c98d6e55 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:26.053245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:26.053898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:26.054188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:26.054470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:26.056703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:26.134909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:26.163187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:26.165481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8ad79-3394-4dbf-9b64-bd098beea308 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:26.184069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 750/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:28.557653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.558199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.558199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.559690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 741/1491] 10.222.0.33 () {54 vars in 926 bytes} [Tue Jul 12 18:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:15:28.565018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41707c-a393-4162-be4f-deab3661e13e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.565428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41707c-a393-4162-be4f-deab3661e13e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.565583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41707c-a393-4162-be4f-deab3661e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.630680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9b41707c-a393-4162-be4f-deab3661e13e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:15:28.631869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9b41707c-a393-4162-be4f-deab3661e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:28.725046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 751/1492] 10.222.0.33 () {58 vars in 1023 bytes} [Tue Jul 12 18:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:15:28.764375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:15:28.765926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:28.869043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574482b-a250-46a7-b97a-e950749e0856 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:15:28.940717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:15:28.941362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:15:28.941649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:15:28.941924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:15:28.943569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:15:28.953316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:29.050818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:15:29.052338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425835c6-487a-48ca-a77f-f6debac1fcfd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:15:29.070208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 742/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:15:38.723254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=82 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:15:39.067905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=50 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:11.127738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:11.128333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:11.128333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:11.201654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:11.202863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:11.300395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 752/1494] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:17:11.308433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:11.308951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:11.309104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:11.383120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:11.384274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:11.483871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 743/1495] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:17:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:17:11.489346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:11.490606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:11.502255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08898637-d2e9-4ff8-b6a5-53650ea204c8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:11.565385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:11.599164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:11.599823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:11.600126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:11.600421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:11.601148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:17:11.601458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:11.602483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:11.602483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:17:11.602483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:17:11.603366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:11.614760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 753/1496] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:17:11.622758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:11.631835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22282b-9b53-420a-8061-dae7415b9613 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:11.692403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:11.725787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:11.726440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:11.726717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:11.726989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:11.727678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:11.729469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:11.729469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:17:11.729469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:17:11.730656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:11.843359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 744/1497] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:17:11 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:17:11.847649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:11.849949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:11.882665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293d2fb-4876-4670-be2b-a57893aea89c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:11.976396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:11.976984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:11.977266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:11.977539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:11.978221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:11.979231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:11.979231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:17:11.979231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:17:11.980749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:12.076857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 754/1498] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:17:11 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:17:12.081029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:12.083313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.143795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a0e831-f255-430c-a622-f85cc5102e92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:12.225704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:12.236231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:12.236844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.237131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.237409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.238136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:12.239211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:12.239211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:17:12.239211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:17:12.240134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:12.252110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 745/1499] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:17:12.256729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:12.258242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.269706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c055d-eff2-4ab9-adfd-94c7b01d92e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:12.295478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:12.366931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:12.367735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.368027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.368345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.369073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:12.370088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:12.370088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:17:12.370088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:17:12.370970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d932d6-98b6-46a1-b62a-0f22826d5ed9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:12.383238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 755/1500] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:17:12.387523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:12.389086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.422677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446a4c3-1d68-4c91-b87c-5c94ce64e7bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:12.517191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:12.518004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.518287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.518564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] PATH_INFO: `/v3/projects/fc751e6daa0a41d2825288369c3ec063/users/ae1cb6836ab64e8db98f6f2a4adb3cf5/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.541389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc751e6daa0a41d2825288369c3ec063, user_id=ae1cb6836ab64e8db98f6f2a4adb3cf5, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:12.542436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:12.542436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:17:12.542436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:17:12.544376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f9c7e-e3bd-483c-a007-a416e5a76758 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:12.623930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 746/1501] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:17:12 2022] PUT /identity/v3/projects/fc751e6daa0a41d2825288369c3ec063/users/ae1cb6836ab64e8db98f6f2a4adb3cf5/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:17:12.636648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcea837-037d-4127-8d22-74551bab6f5d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.636944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcea837-037d-4127-8d22-74551bab6f5d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.637223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcea837-037d-4127-8d22-74551bab6f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.691520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9dcea837-037d-4127-8d22-74551bab6f5d None None] MFA Rules not processed for user `ae1cb6836ab64e8db98f6f2a4adb3cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:12.692831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9dcea837-037d-4127-8d22-74551bab6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.768282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 756/1502] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:17:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:17:12.781124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.781419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.781697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.783073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 747/1503] 10.222.0.33 () {54 vars in 963 bytes} [Tue Jul 12 18:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:12.788460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa951-6961-405e-a4ca-506dd61c2b3c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:12.789004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa951-6961-405e-a4ca-506dd61c2b3c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:12.789281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9aa951-6961-405e-a4ca-506dd61c2b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:12.821073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:12.865255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3c9aa951-6961-405e-a4ca-506dd61c2b3c None None] MFA Rules not processed for user `c342400998514fe5beb96566fba15918`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:12.866470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c9aa951-6961-405e-a4ca-506dd61c2b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.941029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 757/1504] 10.222.0.33 () {58 vars in 1060 bytes} [Tue Jul 12 18:17:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:17:12.948676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:12.950171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:12.999832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:13.052379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b00532-4fa0-4f43-8b5d-02336325d927 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:13.124101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:13.124771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:13.125060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:13.125341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:13.126973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:13.225065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:13.226501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:13.230042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:13.245672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 748/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:17:12 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:17:13.287735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80c0b-cef1-4043-8610-209fcfda3f8a None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:13.288138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80c0b-cef1-4043-8610-209fcfda3f8a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:13.288333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef80c0b-cef1-4043-8610-209fcfda3f8a None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:13.289888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 758/1506] 10.222.0.33 () {52 vars in 829 bytes} [Tue Jul 12 18:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:17:13.293368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:13.294580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:13.388800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb7a00-421b-4d88-896a-c426c88580a5 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:13.479599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:13.480484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:13.480765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:13.481039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] PATH_INFO: `/v3/users/ae1cb6836ab64e8db98f6f2a4adb3cf5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:13.493603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1cb6836ab64e8db98f6f2a4adb3cf5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:13.494629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:13.494629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:17:13.494629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:17:13.495847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:13.505758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:13.729579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1cb6836ab64e8db98f6f2a4adb3cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:13.747500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1cb6836ab64e8db98f6f2a4adb3cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:13.760667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1cb6836ab64e8db98f6f2a4adb3cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:13.838264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1cb6836ab64e8db98f6f2a4adb3cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:13.838804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1cb6836ab64e8db98f6f2a4adb3cf5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:13.844919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 749/1507] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:17:13 2022] DELETE /identity/v3/users/ae1cb6836ab64e8db98f6f2a4adb3cf5 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:17:13.849321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:13.849616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:13.849894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:13.905475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:17:13.906735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:14.020085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:14.032196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 759/1508] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:17:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:17:14.042655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:14.043226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:14.150457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ca15f-61c0-4ed2-a34f-2bf9eaff555b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:14.206847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:14.225244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:14.225891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:14.226171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:14.226442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:14.228081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:14.460369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:14.462131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb85813-1567-4f3d-9822-bad8d3e02872 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:14.480605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 750/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:17:14.940388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:17:14.943587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:17:14.954136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8201265-0ada-4c81-a962-76b596ffb7ee None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:17:15.049976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:17:15.050833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:17:15.051112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:17:15.051383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] PATH_INFO: `/v3/projects/fc751e6daa0a41d2825288369c3ec063` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:17:15.061224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc751e6daa0a41d2825288369c3ec063)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:17:15.062316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:17:15.062316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:17:15.062316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:17:15.063489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:17:15.174253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc751e6daa0a41d2825288369c3ec063', 'request_id': 'req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:15.187089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc751e6daa0a41d2825288369c3ec063', 'request_id': 'req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:15.264089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc751e6daa0a41d2825288369c3ec063', 'request_id': 'req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:15.287411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] The token cache is being invalidate because project fc751e6daa0a41d2825288369c3ec063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:17:15.287910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:15.288304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b9980943-2731-4e8a-bcfe-f6d3213d3fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:17:15.289965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 760/1510] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:17:14 2022] DELETE /identity/v3/projects/fc751e6daa0a41d2825288369c3ec063 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:17:24.478348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=62 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:17:25.285455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:18:59.754509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:59.755126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:59.755126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:59.756490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:18:59.761602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e487f5-4b1e-4a10-89ed-2b8f6a199c36 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:18:59.762041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e487f5-4b1e-4a10-89ed-2b8f6a199c36 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:18:59.762153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e487f5-4b1e-4a10-89ed-2b8f6a199c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:18:59.843960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-94e487f5-4b1e-4a10-89ed-2b8f6a199c36 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:18:59.845196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94e487f5-4b1e-4a10-89ed-2b8f6a199c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:18:59.945403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:00.099370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:00.104896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:00.220025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613087f-d514-4fce-bbe9-527ad3c43cf8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:00.225795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:00.226441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:00.226726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:00.227004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:00.235125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:00.236771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb18ca-0703-469d-a318-b885385cc083 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:00.246537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 752/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:19:01.076621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f110208-3a56-4637-8ef8-2ffb1a33c5ca None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:01.077127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f110208-3a56-4637-8ef8-2ffb1a33c5ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:01.077127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f110208-3a56-4637-8ef8-2ffb1a33c5ca None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:01.078501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:01.083982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:01.084467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:01.084576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:01.102890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:01.104084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:01.111932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:01.255766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278977c-5674-4e99-a8a9-3912b20dd760 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:01.256055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278977c-5674-4e99-a8a9-3912b20dd760 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:01.256359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278977c-5674-4e99-a8a9-3912b20dd760 None None] PATH_INFO: `/v3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:01.257668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 763/1516] 10.222.0.58 () {54 vars in 925 bytes} [Tue Jul 12 18:19:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:19:01.262086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:01.263650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704169c6-749e-474b-acff-e4c630182140 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:01.263938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704169c6-749e-474b-acff-e4c630182140 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:01.264252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704169c6-749e-474b-acff-e4c630182140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:01.275118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db5fdf-e147-468c-8f7b-b2432b3f52cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:01.280696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:01.281334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:01.281616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:01.281893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:01.291027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:01.292651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e29d3-5d6f-4e7a-994b-03850b2afc89 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:01.302098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 754/1517] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:01.324565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-704169c6-749e-474b-acff-e4c630182140 None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:01.325802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-704169c6-749e-474b-acff-e4c630182140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:01.357968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:01.401751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 764/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jul 12 18:19:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:19:05.353816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5921e-82da-4af5-9436-0f38505619b2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:05.354338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5921e-82da-4af5-9436-0f38505619b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:05.354338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5921e-82da-4af5-9436-0f38505619b2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:05.355637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 755/1519] 10.222.0.33 () {54 vars in 960 bytes} [Tue Jul 12 18:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:05.360657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2e55-82dd-4a71-9729-489defbd7392 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:05.361060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2e55-82dd-4a71-9729-489defbd7392 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:05.361221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b2e55-82dd-4a71-9729-489defbd7392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:05.379601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-359b2e55-82dd-4a71-9729-489defbd7392 None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:05.380867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-359b2e55-82dd-4a71-9729-489defbd7392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:05.389415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 765/1520] 10.222.0.33 () {58 vars in 1057 bytes} [Tue Jul 12 18:19:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:05.397107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5921e-82da-4af5-9436-0f38505619b2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:05.409952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5921e-82da-4af5-9436-0f38505619b2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:05.415036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:05.415652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:05.415930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:05.416231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:05.424234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:05.426346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee4bc-29d4-4bd4-9bc7-a61e700dbb4d service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:05.435631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 756/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:12.512947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1598-d67f-4228-8d48-1286bfffa588 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:12.513489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1598-d67f-4228-8d48-1286bfffa588 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:12.513489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d1598-d67f-4228-8d48-1286bfffa588 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:12.514790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:12.520415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d1bb-e0ba-4021-be86-faae3201c68d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:12.520886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d1bb-e0ba-4021-be86-faae3201c68d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:12.521000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d1bb-e0ba-4021-be86-faae3201c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:12.539271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f270d1bb-e0ba-4021-be86-faae3201c68d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:12.540476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f270d1bb-e0ba-4021-be86-faae3201c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:12.548203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:12.700534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1598-d67f-4228-8d48-1286bfffa588 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:12.715253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d1598-d67f-4228-8d48-1286bfffa588 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:12.720711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:12.721343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:12.721626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:12.721899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:12.729978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:12.731596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f93e3a9-fd06-49fd-bf6b-1085524e5f0b service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:12.741291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 767/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:13.550085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a155-ed53-45e4-82b0-1bd7e54dbaa3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:13.550630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a155-ed53-45e4-82b0-1bd7e54dbaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:13.551339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8335a155-ed53-45e4-82b0-1bd7e54dbaa3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:13.552614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 18:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:13.557515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0ccd-9056-439a-a434-d1efaa35abc2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:13.557918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0ccd-9056-439a-a434-d1efaa35abc2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:13.558071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045a0ccd-9056-439a-a434-d1efaa35abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:13.575524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-045a0ccd-9056-439a-a434-d1efaa35abc2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:13.576743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-045a0ccd-9056-439a-a434-d1efaa35abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:13.584422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:13.735081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a155-ed53-45e4-82b0-1bd7e54dbaa3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:13.749795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8335a155-ed53-45e4-82b0-1bd7e54dbaa3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:13.755819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:13.756493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:13.756781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:13.757058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:13.765404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:13.766993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9aa9a-5c5b-4f52-bd14-e6a3b9696cb9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:13.776426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 759/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:17.834979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:17.835450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:17.835568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:17.836963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:17.842146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc43c-4e8a-4754-ab1b-ebef33fa1fb2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:17.842555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc43c-4e8a-4754-ab1b-ebef33fa1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:17.842710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765dc43c-4e8a-4754-ab1b-ebef33fa1fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:17.860362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-765dc43c-4e8a-4754-ab1b-ebef33fa1fb2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:17.861532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-765dc43c-4e8a-4754-ab1b-ebef33fa1fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:17.869977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:17.941910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:17.943674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:18.024309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207acad-04a5-4716-b691-9ef9faeb0474 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:18.027844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:18.028516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:18.028803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:18.029080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:18.038082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:18.039500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c78760-4455-44e7-8047-0509935c5039 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:18.048705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 770/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:20.036342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e9c1-5ddd-4754-bc30-91d107a5b372 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:20.036896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e9c1-5ddd-4754-bc30-91d107a5b372 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:20.036896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645e9c1-5ddd-4754-bc30-91d107a5b372 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:20.038568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:20.043718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd157-1183-4f87-8846-3fae28517036 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:20.044161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd157-1183-4f87-8846-3fae28517036 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:20.044313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302fd157-1183-4f87-8846-3fae28517036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:20.062522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-302fd157-1183-4f87-8846-3fae28517036 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:20.063709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-302fd157-1183-4f87-8846-3fae28517036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:20.071546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:20.106281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645e9c1-5ddd-4754-bc30-91d107a5b372 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:20.117479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645e9c1-5ddd-4754-bc30-91d107a5b372 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:20.120939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:20.121565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:20.121846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:20.122118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:20.131168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:20.132616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d1a61-02f7-4da8-b276-d854736a1cff service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:20.141831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 762/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:23.790662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:23.791218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:23.791218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:23.792661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:23.798016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33786996-864b-4d8b-9936-fe92adb884e0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:23.798464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33786996-864b-4d8b-9936-fe92adb884e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:23.798605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33786996-864b-4d8b-9936-fe92adb884e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:23.818415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-33786996-864b-4d8b-9936-fe92adb884e0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:23.819304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33786996-864b-4d8b-9936-fe92adb884e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:23.827532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:24.137761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:24.139460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:24.223196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105cd414-144d-452e-9bab-75958f0d19bd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:24.227000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:24.227643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:24.227929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:24.228235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:24.235464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:24.238069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:24.239563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c496ab6-881a-4f63-890d-a58cd415d6ff service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:24.249978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 773/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:26.306963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:26.307493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:26.307493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:26.308929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 18:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:19:26.314128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8515-0c70-4485-9466-b6f09b75a3a8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:26.315449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8515-0c70-4485-9466-b6f09b75a3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:26.315449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff8515-0c70-4485-9466-b6f09b75a3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:26.333218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e3ff8515-0c70-4485-9466-b6f09b75a3a8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:19:26.334457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3ff8515-0c70-4485-9466-b6f09b75a3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:26.342183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 18:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:19:26.642306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:19:26.643942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:19:26.651481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:26.657126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c90a3-56dc-4c8d-bb5f-6790a6fe92d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:19:26.660610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:19:26.663568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:19:26.663568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:19:26.663568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:19:26.671149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:19:26.672603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212c3af-fee2-4b05-a4b6-c781e0873adb service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:19:26.682857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 765/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:19:36.327934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:19:36.678606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:00.575734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.576461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.576461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.598713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:00.599931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:00.615333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 775/1540] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:00.624288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.624842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.624842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.652306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:00.653512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:00.665505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 766/1541] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:00.669983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:00.685423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c55654-01f7-4ecf-9096-e9e529901270 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:00.692596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:00.693484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.693948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.694405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.695319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:00.695793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:00.697661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:00.723156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 776/1542] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:00.731628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:00.746304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc622091-c541-4158-8745-9e0e4eff9cbb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:00.754365 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:00.755327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.755761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.756346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.757454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:00.759990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42907a81-4c4d-4e69-b899-f65c835c5566 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:00.894769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 767/1543] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:00 2022] POST /identity/v3/projects => generated 383 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:00.903304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:00.919856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133de699-3148-4f05-b870-f701fa83c0e1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:00.962242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b6ffe-b63d-45fd-90c2-e446996da6f2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.963898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b6ffe-b63d-45fd-90c2-e446996da6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.963898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b6ffe-b63d-45fd-90c2-e446996da6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.996312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:00.998204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:00.998204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:00.998204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:00.998479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.000659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.002064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e9b6ffe-b63d-45fd-90c2-e446996da6f2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.003429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e9b6ffe-b63d-45fd-90c2-e446996da6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.028975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 768/1544] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.038896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.039367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.039792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.077194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.079089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.106172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 769/1545] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:01.111502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.121555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0bb9d-f3fd-4a3d-9b66-2ec8fa2bb6c2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.140271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.144766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.144766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.144766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.144766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:01.144766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.145330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:01.145330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:21:01.145330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:21:01.146204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.152139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 777/1546] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:00 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:01.152139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.174357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 770/1547] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:21:01.179264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec26621-32b4-4e7c-a0f0-07240cb8fcf4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.179745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.181830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.182525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.182949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.183238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.183980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.190723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fbac34-289d-4f00-9ae3-fe4b96708009 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.201527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ffd413-f9d6-439a-9740-7e2bf741dfd3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.210872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 778/1548] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:01.212349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.216136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.216136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.217048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.217930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.218380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.218812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.219655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.222823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.243722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.244960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.266602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 779/1549] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.268229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.283734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac615-34f8-413f-939a-c01dba05a022 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.288844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.289532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.289821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.290103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.290844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.292497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387662fb-1ead-4602-8730-d0d040be8f55 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.308654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 780/1550] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:01.312860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.313164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.313454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.341621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.342848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.347477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 771/1551] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:01.348574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.355405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 781/1552] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.358388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.371513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086d554-34fa-4432-8f26-7e763a601316 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.431931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82bbcc-6882-4720-bbed-b12a0b8928b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.438986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.440483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.440769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.441087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] PATH_INFO: `/v3/projects/63290439e70e483987c4087addcd4ea7/users/d1e1edac4a2f430ea534bf4911988d45/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.442588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.443261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.443553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.443836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.444563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.446489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88f2a5-d525-4e22-8099-fa23e9b04106 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.456651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63290439e70e483987c4087addcd4ea7, user_id=d1e1edac4a2f430ea534bf4911988d45, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.459487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.532163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 772/1553] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:01 2022] PUT /identity/v3/projects/63290439e70e483987c4087addcd4ea7/users/d1e1edac4a2f430ea534bf4911988d45/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:01.533095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.589877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:01.591586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 782/1554] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:01.593610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152253d-3c2c-4e1e-a58d-ca28a75b9f34 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.596043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b8ed-265b-4816-a75a-5b568d7f85ac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.596359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b8ed-265b-4816-a75a-5b568d7f85ac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.596644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e576b8ed-265b-4816-a75a-5b568d7f85ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.598526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.599190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.599479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.599759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.600535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:01.600841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.602450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c580638-799c-4992-ab12-439bc27acda9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.614973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e576b8ed-265b-4816-a75a-5b568d7f85ac None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.618880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e576b8ed-265b-4816-a75a-5b568d7f85ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.619001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 773/1555] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:01.619001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49008-6ac8-4cfa-9dba-906500fe2f6a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.619001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49008-6ac8-4cfa-9dba-906500fe2f6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.619001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e49008-6ac8-4cfa-9dba-906500fe2f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.629845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 783/1556] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.631150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad57-300c-4f48-853a-b26060bdfada None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.631441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad57-300c-4f48-853a-b26060bdfada None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.631716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5ad57-300c-4f48-853a-b26060bdfada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.642896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-93e49008-6ac8-4cfa-9dba-906500fe2f6a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.644259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93e49008-6ac8-4cfa-9dba-906500fe2f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.649308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-69f5ad57-300c-4f48-853a-b26060bdfada None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.650504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-69f5ad57-300c-4f48-853a-b26060bdfada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.652518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 774/1557] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.653905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488964aa-3375-4e09-91c6-e5590edf2fa9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.654212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488964aa-3375-4e09-91c6-e5590edf2fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.654492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488964aa-3375-4e09-91c6-e5590edf2fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.659418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 784/1558] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.660972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.661301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.661876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.678599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-488964aa-3375-4e09-91c6-e5590edf2fa9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.679739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.680095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-488964aa-3375-4e09-91c6-e5590edf2fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.680928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.688091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 775/1559] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.688917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 785/1560] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.690160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.692808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.693140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.693419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.702611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:01.706452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9620-321a-4de3-a115-6b74551a7d99 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.711201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.711864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.713186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.713290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.713398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.713398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.713597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.714839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076da9a7-d6db-4463-9f9e-4ad8badd06d9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.721178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 776/1561] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.721936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.724792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 786/1562] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:01.728951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c4ec-d6aa-49ac-a460-c6417d45feee None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.729351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c4ec-d6aa-49ac-a460-c6417d45feee None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.729519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2091c4ec-d6aa-49ac-a460-c6417d45feee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.731733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60cf4f-8cb2-46b2-bb45-157fe89adab6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.737296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.737950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.738230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.738501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.739180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.741172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e88b55-0739-4220-aab7-93a4375726e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.748869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2091c4ec-d6aa-49ac-a460-c6417d45feee None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.750087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2091c4ec-d6aa-49ac-a460-c6417d45feee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.759114 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 787/1563] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.762759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29579e-ffa0-4491-b349-03ef16f42556 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.762759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29579e-ffa0-4491-b349-03ef16f42556 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.762759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29579e-ffa0-4491-b349-03ef16f42556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.778359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fc29579e-ffa0-4491-b349-03ef16f42556 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.779545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc29579e-ffa0-4491-b349-03ef16f42556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.787881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 788/1564] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.789243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b67d-fff8-4f7c-a4a7-19ba589eef01 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.789541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b67d-fff8-4f7c-a4a7-19ba589eef01 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.793455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323b67d-fff8-4f7c-a4a7-19ba589eef01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.807369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a323b67d-fff8-4f7c-a4a7-19ba589eef01 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.808573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a323b67d-fff8-4f7c-a4a7-19ba589eef01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.817675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 789/1565] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.819010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.819308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.819603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.827037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 777/1566] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/projects => generated 389 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:01.831647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.831647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.831647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.838553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.839755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.847174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:01.848366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:01.898984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 790/1567] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.899661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.907664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 778/1568] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:01.908434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e1007-5a5c-4538-805b-9fd6f37c24f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.912596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.913299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.913946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.914229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.914506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.915230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.916848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.930226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 791/1569] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:01.930226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.937649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dfbc3d-49bd-4817-9048-67064a439195 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.943154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.943741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.944022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.944340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.945067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:01.945923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.947307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.961449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 792/1570] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:01.969285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:01.972174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52763862-1cef-4881-a5be-ed50f02b413b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.975877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.976644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.977088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.977463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.979915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2892d1-16a7-4093-8c8c-f37b5defe6bb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:01.984711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:01.985565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:01.985856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:01.986131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:01.987546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:01.987850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.988056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:01.989463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.989568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:01.999166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 779/1571] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:01.999986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.006190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 793/1572] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:02.007016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.015912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dad0c1c-a823-4db0-8f40-024e3d08decc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.017432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62b212-a290-4f47-be74-538da556a6aa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.021043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.021773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.022189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.022509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.022662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.023266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:02.023376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.023574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.023699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.023953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.024694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.025206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.026596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.045135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 780/1573] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:02.045135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.049466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c4da0-d31d-46d4-bce5-ddbf0fe421c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.054365 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.055048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.055361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.055640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.056421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:02.056733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.058319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.070645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 781/1574] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:02.071302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.081065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edab15-3392-4ac6-a336-be3867394728 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.086265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.087015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.087379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.087712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.088673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:02.089508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.090681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.095595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 794/1575] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.096956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.107158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa306bd6-de2c-45ce-ad9b-2213e004cda1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.107337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 782/1576] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:02.108064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.119205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.120811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.121313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.121705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] PATH_INFO: `/v3/projects/88cc669910ae4278aa9d848f37762a49/users/e9ef79174340406792634d3a314f0013/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.123614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b70d7d5-45ae-4524-a671-fde19a91dfb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.129249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.129916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.130202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.130485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.131352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.133502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.138799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cc669910ae4278aa9d848f37762a49, user_id=e9ef79174340406792634d3a314f0013, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.139945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:02.139945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:21:02.139945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:21:02.142169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.147217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:02.206801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 795/1577] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:02 2022] PUT /identity/v3/projects/88cc669910ae4278aa9d848f37762a49/users/e9ef79174340406792634d3a314f0013/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:02.207556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.241487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 783/1578] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.241487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.288891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:02.296064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724234c-b5c1-46e0-bc4a-2035072f2895 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.321417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4edcf-3d6a-49a9-91d5-a212e327767a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.329370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.330528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.330822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.331097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.331849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.334312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.376043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.376845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.377223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.377696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.378482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.380446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:02.380446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:21:02.380446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:21:02.382008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.462142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 784/1579] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/projects => generated 355 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.462981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.507862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 796/1580] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/projects => generated 373 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.512027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.534767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418b2d27-4d67-4dad-b788-f0e1eee9de45 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.588348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf958012-7cf8-4b81-bdd1-4fb6d0d55106 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.594203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.594818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.594818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.595083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.596656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.597608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.598283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.598404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.598599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.598838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.599532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.601474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc861bab-cd8e-4273-ba07-b6566366514b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.624365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 797/1581] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:02.626209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.638163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625347e-7b95-49b2-8465-d9909e65f67a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.647887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.648611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.648909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.649177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.649881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.651850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.694149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 785/1582] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.695742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.696045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.696352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.720192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:02.729161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] MFA Rules not processed for user `e9ef79174340406792634d3a314f0013`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:02.730456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:02.778670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 798/1583] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/projects => generated 391 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:02.782893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.801596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 786/1584] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:02.802769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:02.876401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d7787-09c9-49dc-9604-d660d78bfecb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.880996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf11db-f370-4f66-8bd6-1808f57d3763 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:02.882017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.882997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.883342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.883628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.884429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.886316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.888208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:02.888208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:02.888208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:02.888208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:02.888591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:02.889499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:02.889499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:21:02.889499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:21:02.890696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:02.895333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:03.018177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 799/1585] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:03.018177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.018679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 787/1586] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/users => generated 278 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:03.018679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.018870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170adea-0554-4abf-aad2-1f80e478e6df admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.018967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa690583-bb12-4917-8d60-d2fac613f869 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.019077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.019077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.019077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.019077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.019516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.019611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.019611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.019845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a4035-1bc5-4344-bb23-5fefe4cf673d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.019935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.019935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.019935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.019935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.032753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 788/1587] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.033705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.048518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd632820-8116-4e46-978a-edde0c4e314d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.054079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.054898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.055270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.055609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.056397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.059035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.175969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 789/1588] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:03 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:03.176543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 800/1589] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:02 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:03.177219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.178284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdae9-9437-4951-b94c-f1494569c980 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.179015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdae9-9437-4951-b94c-f1494569c980 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.179529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43efdae9-9437-4951-b94c-f1494569c980 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.181173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 801/1590] 10.222.0.33 () {54 vars in 961 bytes} [Tue Jul 12 18:21:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:03.182303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdae9-9437-4951-b94c-f1494569c980 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.195006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc6dbc7-af1c-4387-b941-7d963a6b51e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.197269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43efdae9-9437-4951-b94c-f1494569c980 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.200016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.200828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.201143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.201477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.202176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.202300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.202846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.203134 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.203411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.204157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.204273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.205788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.216710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 802/1591] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.221836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.227169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129371-1dfa-45dc-95ba-f55abf6871ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.231803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.232474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.232762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.233040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.233825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.235430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.245853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 803/1592] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.250796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.265481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee45c544-94c7-48eb-bf1f-3f3ce17dca86 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.270472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.271413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.271795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.272248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] PATH_INFO: `/v3/projects/2383d509edfc48d5a3b2f23124f584ab/users/50724984775d4248a5975459d8c2c76a/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.287628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2383d509edfc48d5a3b2f23124f584ab, user_id=50724984775d4248a5975459d8c2c76a, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.290402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.304705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 790/1593] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:03 2022] POST /identity/v3/users => generated 296 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:03.306852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.316084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7d326-eafb-42c6-8adb-8bc7694cf3bc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.320962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.321725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.322118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.322396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.323118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.324746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.341017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 791/1594] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.341017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.350779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03267cb-a9de-42f6-beec-7694bffe4f85 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.356023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.356669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.356949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.357220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.357946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.359586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6bfa3-3143-46c9-9d72-ce0d921d91b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.372003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 792/1595] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.373852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.373852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.374167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.388225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 804/1596] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:03 2022] PUT /identity/v3/projects/2383d509edfc48d5a3b2f23124f584ab/users/50724984775d4248a5975459d8c2c76a/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:03.393477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.416086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:03.419704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:03.420952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:03.458481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3ef428-6725-4083-b1ae-0678b6fa3edd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.464005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.464796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.465177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.465751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.466331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.468012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.480458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 805/1597] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.481942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.498253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f566c-029e-4fd9-bbe9-a792a12dc426 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.503401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.505782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.505782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.505782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.505782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.507202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.515251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 793/1598] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Jul 12 18:21:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:03.516591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.518419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 806/1599] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.519347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.531908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983782d0-c95c-4826-b251-ff92741c3006 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.536971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a85a87-6a66-43e7-a913-caa8a5bc241c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.538471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.539343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.539806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.540349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.541250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.543222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.543651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.544624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.545569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.546022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.547041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.550354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37913296-ed11-42f4-a4f4-a5bdf8881d47 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.562508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 807/1600] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.562508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.566792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 794/1601] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.568275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.568631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.568982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.571238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764ee68-7511-4504-8f86-589c89918408 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.576162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.576617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.576906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.577185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.577914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.579551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.587215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:03.594037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:03.594155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 808/1602] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.594155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.601818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 795/1603] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:03.602661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.603702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6910579-bad2-48fe-982f-92ce50444f6d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.610882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.612746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.613027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.613303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] PATH_INFO: `/v3/projects/a725964ffc85455eb6387c70df67a800/users/7f6e097dbb8e4403a735d0bab3e1b0bf/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.622660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110f815-6c15-4e1b-ac2c-3d64f327e356 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.629208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a725964ffc85455eb6387c70df67a800, user_id=7f6e097dbb8e4403a735d0bab3e1b0bf, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.629435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.630073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.630359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.631020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.631864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.693483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.695125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.704245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 796/1604] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:03.705129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.715276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199359a-f90c-4948-b893-3cc85b2c4399 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.719918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.723858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.723858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.723858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] PATH_INFO: `/v3/projects/7bddc698ee56403a9f53fbd45d277dbc/users/5a2a4a1b6593473f8b0520d50b35abbc/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.737277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bddc698ee56403a9f53fbd45d277dbc, user_id=5a2a4a1b6593473f8b0520d50b35abbc, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.739986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.746368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 809/1605] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:03 2022] PUT /identity/v3/projects/a725964ffc85455eb6387c70df67a800/users/7f6e097dbb8e4403a735d0bab3e1b0bf/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:03.747348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.793082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:03.843799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305e182-cbce-4496-944e-e4e464c32967 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.851428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 797/1606] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:03 2022] PUT /identity/v3/projects/7bddc698ee56403a9f53fbd45d277dbc/users/5a2a4a1b6593473f8b0520d50b35abbc/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:03.851428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.942659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:03.951700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efa235-2a20-4cd7-af27-60c498f949a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:03.958302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.958546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:03.959306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.959441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:03.959637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.959899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:03.960012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] PATH_INFO: `/v3/projects/11f4126274c8408b86ff4cf5b39ca4c5/users/e146659a88964a23bc7113166311b943/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.960388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:03.961233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.964510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.977456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f4126274c8408b86ff4cf5b39ca4c5, user_id=e146659a88964a23bc7113166311b943, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:03.980519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:03.982686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 798/1607] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:03.983659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:03.997241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8f6ce-ac14-4056-a0b5-d54310a8edfc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.003654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.004855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.011335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.011335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] PATH_INFO: `/v3/projects/8ede57ec8b9b44eca27998b4a35227d4/users/8574543890ef454e8fdf5531622484b0/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.022548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ede57ec8b9b44eca27998b4a35227d4, user_id=8574543890ef454e8fdf5531622484b0, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.025370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc37f7-9857-4578-b6f9-e93272394379 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.092777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 810/1608] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:03 2022] PUT /identity/v3/projects/11f4126274c8408b86ff4cf5b39ca4c5/users/e146659a88964a23bc7113166311b943/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:04.097666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:04.099332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.154252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 799/1609] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:03 2022] PUT /identity/v3/projects/8ede57ec8b9b44eca27998b4a35227d4/users/8574543890ef454e8fdf5531622484b0/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:04.154252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add50c-17d3-42db-9e90-66bf4db0cd32 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.154252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add50c-17d3-42db-9e90-66bf4db0cd32 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.154252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2add50c-17d3-42db-9e90-66bf4db0cd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.183029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe399-331b-459c-9781-fef2086b838e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.217154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2add50c-17d3-42db-9e90-66bf4db0cd32 None None] MFA Rules not processed for user `7f6e097dbb8e4403a735d0bab3e1b0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.217154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2add50c-17d3-42db-9e90-66bf4db0cd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.262227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.262898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.263189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.263478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.296174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:04.300268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 800/1610] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.302264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0d48-eaf9-4734-aa31-a0dadd55b0c5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.302914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0d48-eaf9-4734-aa31-a0dadd55b0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.303386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0d48-eaf9-4734-aa31-a0dadd55b0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.338464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61db0d48-eaf9-4734-aa31-a0dadd55b0c5 None None] MFA Rules not processed for user `5a2a4a1b6593473f8b0520d50b35abbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.339693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61db0d48-eaf9-4734-aa31-a0dadd55b0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.343625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.345423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c4326-aa3b-4851-b60b-969d5d98c0ac service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.358748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 811/1611] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:04.360360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d6ac-21dc-4781-9c4a-5f2fbc24d5d5 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.360653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d6ac-21dc-4781-9c4a-5f2fbc24d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.363670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9897d6ac-21dc-4781-9c4a-5f2fbc24d5d5 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.363670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 812/1612] 10.222.0.33 () {54 vars in 912 bytes} [Tue Jul 12 18:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:04.363670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897d6ac-21dc-4781-9c4a-5f2fbc24d5d5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:04.378496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9897d6ac-21dc-4781-9c4a-5f2fbc24d5d5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.385739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.386642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.386916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.387189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] PATH_INFO: `/v3/projects/0dd56876c32242128356a63e830c6d09/users/c39a7058d0e1423f8d8464eb4c09e490/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.404823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd56876c32242128356a63e830c6d09, user_id=c39a7058d0e1423f8d8464eb4c09e490, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.407932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.442300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 801/1613] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.444040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926f79-0306-45cd-a7dc-aeeeb419b0ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.444040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926f79-0306-45cd-a7dc-aeeeb419b0ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.445200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa926f79-0306-45cd-a7dc-aeeeb419b0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa926f79-0306-45cd-a7dc-aeeeb419b0ff None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa926f79-0306-45cd-a7dc-aeeeb419b0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 802/1614] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2ded7-c52f-48fe-ae6e-3550469873a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2ded7-c52f-48fe-ae6e-3550469873a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.576481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca2ded7-c52f-48fe-ae6e-3550469873a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.578179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 813/1615] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:04 2022] PUT /identity/v3/projects/0dd56876c32242128356a63e830c6d09/users/c39a7058d0e1423f8d8464eb4c09e490/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:04.578179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:04.578575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8ca2ded7-c52f-48fe-ae6e-3550469873a5 None None] MFA Rules not processed for user `8574543890ef454e8fdf5531622484b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.578575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ca2ded7-c52f-48fe-ae6e-3550469873a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.616717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:04.623544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4397d7-f8e8-4745-9007-0388675015f8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.628456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.629135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.629418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.629693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.630389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.632361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.662256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 803/1616] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.663588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.663878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.664523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.687686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.689202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.766447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 814/1617] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/projects => generated 365 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:04.769066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:04.811849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 804/1618] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.815109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:04.884727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7439c53-3a7e-452d-8dac-5d80e288a725 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.889808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa7fb1-418b-4cd5-ba73-9c181b9d0a78 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:04.893038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.893038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.893038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.893038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.893434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.895243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.940346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:04.941049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.946663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.946663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.950925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:04.952398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d072b0-4cdf-486b-ab20-425d9c0f5d77 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:04.963323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 805/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:04.965642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03827f-1a3b-407e-bdea-eef8a2483872 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.965962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03827f-1a3b-407e-bdea-eef8a2483872 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.966209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c03827f-1a3b-407e-bdea-eef8a2483872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.986165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1c03827f-1a3b-407e-bdea-eef8a2483872 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:04.987361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c03827f-1a3b-407e-bdea-eef8a2483872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:04.995339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 806/1620] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:04.996493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c57f1e-4402-4c5d-9008-c1c4431303bf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:04.996776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c57f1e-4402-4c5d-9008-c1c4431303bf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:04.997049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c57f1e-4402-4c5d-9008-c1c4431303bf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:04.998598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 807/1621] 10.222.0.33 () {54 vars in 961 bytes} [Tue Jul 12 18:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:04.999435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c57f1e-4402-4c5d-9008-c1c4431303bf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.012721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c57f1e-4402-4c5d-9008-c1c4431303bf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.018920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.019783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.020004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.020330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.021079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.023043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a587599e-21f9-445d-81a3-e3adfdb3f295 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.059739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 815/1622] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/projects => generated 355 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:05.060795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.077215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:05.141800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c0f6a8-a7b3-44c9-924b-fae243897913 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.149282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 808/1623] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:04 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:05.149943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.150785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.150931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.151082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.151183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.151398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.151508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.176075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:05.177654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:05.253285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.255094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.256008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:05.275346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 816/1624] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:05.276331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.285289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 809/1625] 10.222.0.33 () {58 vars in 1058 bytes} [Tue Jul 12 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:05.286821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.378458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687be43-375b-4043-8963-08bf77667900 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.382893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.383764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.385261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.385261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.386648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a9a15-ddee-42d1-a3c5-2c803f09d097 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.391893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.392837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.393915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.394414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.395114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.398516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.398677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.400615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.418836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 817/1626] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:05.420021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.433070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf2dd25-da5a-47ca-a544-62f9372c24e5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.440225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.442681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.442681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.442681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.442681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.448065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.462880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 818/1627] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:05.470748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.481269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df43e56c-0fe8-47c3-85ee-6a1e8c892d12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.496159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 810/1628] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:05 2022] POST /identity/v3/users => generated 284 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:05.498436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.500768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.501821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.502989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.503676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.521487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25d48-2607-4151-b123-fe5d448ee48f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.537150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.538482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.538482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.538736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] PATH_INFO: `/v3/projects/b9cd92984f6645fca37484f94988c988/users/478f4eaba5bf416da87774316c492fc5/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.565123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd92984f6645fca37484f94988c988, user_id=478f4eaba5bf416da87774316c492fc5, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.567833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.602606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:05.615246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.616890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.629594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 819/1629] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:05.630543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.641874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe28ac-3040-4722-abdb-4ce1abf0f59c service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.647011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.648343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.648732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.649847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.650734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.652478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.667784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 820/1630] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:05.669094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.681657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581482bb-a90c-404d-9fff-ff8261736e62 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.687342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.688381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.689183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.689183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] PATH_INFO: `/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78/users/5056cf27a20f43a4afb2a4fee57aef6b/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.707479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f74a83d3cdd4efe9f80d86074cf6a78, user_id=5056cf27a20f43a4afb2a4fee57aef6b, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.710623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:05.744334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 811/1631] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:05 2022] PUT /identity/v3/projects/b9cd92984f6645fca37484f94988c988/users/478f4eaba5bf416da87774316c492fc5/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:05.745294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.882770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:05.884570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7812d-cb44-42a7-9559-1344bfed5b52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:05.889163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 821/1632] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:05 2022] PUT /identity/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78/users/5056cf27a20f43a4afb2a4fee57aef6b/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:05.890235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:05.995059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:05.995745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:05.996030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:05.996332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:05.997072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:05.998685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.024584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 812/1633] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:06.025499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:06.046586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7ebc9-528e-4cc9-be85-01b7ca460f5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.059309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.060369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.060673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.060950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] PATH_INFO: `/v3/projects/b9cd92984f6645fca37484f94988c988/users/478f4eaba5bf416da87774316c492fc5/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.075879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab47baf-6473-4a95-a25a-dde72ca57f9a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.076017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cd92984f6645fca37484f94988c988, user_id=478f4eaba5bf416da87774316c492fc5, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.076017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af5b24-b0f5-4e76-a817-1a5fd9f0dd46 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.084410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.086359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.086359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.086708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.087719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.089789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.096768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 813/1634] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:06 2022] PUT /identity/v3/projects/b9cd92984f6645fca37484f94988c988/users/478f4eaba5bf416da87774316c492fc5/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:06.109192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a795-c33d-4ec1-9526-39bf7bd97abe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.109487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a795-c33d-4ec1-9526-39bf7bd97abe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.109827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707a795-c33d-4ec1-9526-39bf7bd97abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.112189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 822/1635] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:06.152210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:06.171675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2707a795-c33d-4ec1-9526-39bf7bd97abe None None] MFA Rules not processed for user `478f4eaba5bf416da87774316c492fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:06.172958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2707a795-c33d-4ec1-9526-39bf7bd97abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:06.185182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb045cb5-b5db-4483-9527-3eb76c90beea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.311338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.312901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.313178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.313436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] PATH_INFO: `/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78/users/5056cf27a20f43a4afb2a4fee57aef6b/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.318588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f74a83d3cdd4efe9f80d86074cf6a78, user_id=5056cf27a20f43a4afb2a4fee57aef6b, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.322027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b28070-8440-4da7-9ebe-611cffee9173 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.347969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 823/1636] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:06 2022] PUT /identity/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78/users/5056cf27a20f43a4afb2a4fee57aef6b/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:06.351495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c91d-0306-4c4a-8ed2-adf5ba634a3f None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.351792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c91d-0306-4c4a-8ed2-adf5ba634a3f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.353184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d7c91d-0306-4c4a-8ed2-adf5ba634a3f None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.356633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 824/1637] 10.222.0.33 () {54 vars in 912 bytes} [Tue Jul 12 18:21:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:06.360008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.360339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.361648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.398723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 814/1638] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:06.400414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852939-2632-4dda-b947-1b72952a0754 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.409115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852939-2632-4dda-b947-1b72952a0754 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.409115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852939-2632-4dda-b947-1b72952a0754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.431211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] MFA Rules not processed for user `5056cf27a20f43a4afb2a4fee57aef6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:06.433432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:06.439777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-58852939-2632-4dda-b947-1b72952a0754 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:06.451059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-58852939-2632-4dda-b947-1b72952a0754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:06.487781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:06.566992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 825/1639] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:06.568366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:06.576004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 815/1640] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:06.661142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58852939-2632-4dda-b947-1b72952a0754 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:06.674278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58852939-2632-4dda-b947-1b72952a0754 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.680032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.681154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.681852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.682359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.685350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f868a04-cf43-46eb-b84a-a3567a07b002 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.689921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:06.695662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.696370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.696657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.696936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.704483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.707155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.723791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 816/1641] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:06.855582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.855799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:06.857081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.870006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 826/1642] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:06.872268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130968f9-8c84-426e-8318-9e5c91089dce service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:06.877387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:06.878279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:06.878772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:06.879289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:06.893381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:06.896440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:06.913820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 817/1643] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:07.821979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:07.821979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72ca0-de6b-4e4a-925c-aa8d1fedcbb0 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:07.821979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:07.821979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:07.825242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:07.825242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:07.825242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:07.825242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:07.825242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 827/1644] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:07 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:08.164443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:08.178972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc5d554-cb44-46ad-9fa5-fceda8e87944 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:08.192191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:08.193135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:08.193559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:08.194633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:08.374738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:08.377424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2bdd7-f53d-4055-8c63-6b74487d3ef5 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:08.409275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 818/1645] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:12.709207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:12.733836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:12.880245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5d3d1-5078-4786-ae90-28f3a2c20e35 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:12.888296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:12.889373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:12.889823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:12.890104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] PATH_INFO: `/v3/users/8574543890ef454e8fdf5531622484b0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:12.892064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8574543890ef454e8fdf5531622484b0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:12.893849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: WARNING py.warnings [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:12.893849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: warnings.warn(msg) Jul 12 18:21:12.893849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: Jul 12 18:21:12.900935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:13.246381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8574543890ef454e8fdf5531622484b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:13.320795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8574543890ef454e8fdf5531622484b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:13.335544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8574543890ef454e8fdf5531622484b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:13.489568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8574543890ef454e8fdf5531622484b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:13.490231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d5df1446-8e43-4a28-a88a-16d3bcbae4c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8574543890ef454e8fdf5531622484b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:13.505136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 828/1646] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:12 2022] DELETE /identity/v3/users/8574543890ef454e8fdf5531622484b0 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:13.506950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:13.507438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:13.507540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:13.539167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:13.540866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:13.684906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 819/1647] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:13.817522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:13.818359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:13.818787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:13.837154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:13.838857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:13.918885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] MFA Rules not processed for user `d1e1edac4a2f430ea534bf4911988d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:13.924278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:13.974161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3266e6f0-16de-46aa-be09-9d629d740e8f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:13.997624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:13.998589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:13.999049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:13.999510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:14.018940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:14.024040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:14.044453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 820/1648] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:14.074887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 829/1649] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:14.088981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:14.090664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:14.127650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:14.299999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e687f91-475d-4497-a6c8-0d9c11618592 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:14.335216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:14.336413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:14.336806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:14.338366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:14.365525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:14.367517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49196be5-cfb8-4d7f-bc42-99e68f3b076d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:14.385733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 821/1650] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:15.915804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:15.919265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:15.948018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f006b65-d69a-4459-90fb-647481e35ac6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:15.967659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:15.969229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:15.969875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:15.970455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] PATH_INFO: `/v3/projects/8ede57ec8b9b44eca27998b4a35227d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:15.973199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ede57ec8b9b44eca27998b4a35227d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:15.976694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:16.023078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:16.166656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ede57ec8b9b44eca27998b4a35227d4', 'request_id': 'req-de5c1d92-409e-40cb-9f00-15e47f2893f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.180678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ede57ec8b9b44eca27998b4a35227d4', 'request_id': 'req-de5c1d92-409e-40cb-9f00-15e47f2893f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.322980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ede57ec8b9b44eca27998b4a35227d4', 'request_id': 'req-de5c1d92-409e-40cb-9f00-15e47f2893f8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.328035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] The token cache is being invalidate because project 8ede57ec8b9b44eca27998b4a35227d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:16.328950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.332603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.338929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 830/1651] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:15 2022] DELETE /identity/v3/projects/8ede57ec8b9b44eca27998b4a35227d4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:16.345857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cad5e-b9c2-434f-95ce-f9ddf25264b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.346759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cad5e-b9c2-434f-95ce-f9ddf25264b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.347364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409cad5e-b9c2-434f-95ce-f9ddf25264b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.438314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:16.440260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:16.457339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-409cad5e-b9c2-434f-95ce-f9ddf25264b7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:16.463491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-409cad5e-b9c2-434f-95ce-f9ddf25264b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:16.606124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c1d92-409e-40cb-9f00-15e47f2893f8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:16.623767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:16.624752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.625037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.625311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] PATH_INFO: `/v3/users/e9ef79174340406792634d3a314f0013` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.631018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ef79174340406792634d3a314f0013)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:16.633096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:16.645572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 822/1652] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:16.653936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.654559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.654910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.681906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:16.684240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:16.703221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 823/1653] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:16.705837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:16.724085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e9223-e406-4d63-859d-f277f307bfdc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:16.729968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:16.730873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.731633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.732393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.734407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:16.734920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:16.737224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:16.759101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 824/1654] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:16.760915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:16.774751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91464-2403-4fca-bf91-7ad0bcce9a4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:16.782542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:16.784004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:16.784702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:16.785211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:16.787877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:16.790693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:16.944505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ef79174340406792634d3a314f0013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:16.991249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 825/1655] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:16 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:16.991249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:16.991623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ef79174340406792634d3a314f0013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:17.004492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ef79174340406792634d3a314f0013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:17.100435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124af39-1bc8-4b53-b4c6-a16d6fba6bc3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.112995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.113898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.114181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.115236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.116051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.122334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.134084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ef79174340406792634d3a314f0013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:17.134769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-84ea7608-9cac-46b8-8d4e-49d662fd00bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ef79174340406792634d3a314f0013'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:17.135403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:17.141722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 831/1656] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:16 2022] DELETE /identity/v3/users/e9ef79174340406792634d3a314f0013 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:17.147081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.147385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.147696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.204205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:17.206149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.262977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 826/1657] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:16 2022] POST /identity/v3/users => generated 302 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:17.267731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:17.270056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.299433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53cc26-439d-4ede-99b3-c7535df44846 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.368006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 832/1658] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:17.420980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.421854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.422180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.423667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.424858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.430513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.442771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:17.444248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:17.451676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 827/1659] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:17.457731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:17.487674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884071c-6aaf-412c-bf4c-653c56a7496f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.499382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.502162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.502471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.502761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.507356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.513979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.541189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 828/1660] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:17 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:17.545662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:17.567032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87abdd28-9019-441d-ba82-7cc5e11732dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.583027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.584809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.586638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.587162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] PATH_INFO: `/v3/projects/58b49eb7d47d4431a851f142b8e7d7d9/users/d57cb317aa714e7d997ce9a8750b4430/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.605033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fddb02-beb8-4770-afa7-068dc5916be0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:17.612950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:17.615522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.616087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.616870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.622652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b49eb7d47d4431a851f142b8e7d7d9, user_id=d57cb317aa714e7d997ce9a8750b4430, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.632664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd652ae-d728-43b1-bcfc-83d2bee0e2b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.642102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:17.645059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b18de80-478b-4244-aa36-afe373e17116 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:17.666540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 833/1661] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:17.812586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 829/1662] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:17 2022] PUT /identity/v3/projects/58b49eb7d47d4431a851f142b8e7d7d9/users/d57cb317aa714e7d997ce9a8750b4430/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:17.814755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:17.815255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:17.815733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:17.934510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] MFA Rules not processed for user `d57cb317aa714e7d997ce9a8750b4430`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:17.936395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:18.098749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.099514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.099514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.112476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 834/1663] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:18.121473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.151117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] MFA Rules not processed for user `50724984775d4248a5975459d8c2c76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:18.153281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:18.306989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 830/1664] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:18.313555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.316010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:18.323831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da2cff7-330e-4882-ab36-fdd1f65b6cf0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:18.344783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:18.345561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.345856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.346208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.346925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:18.349714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:18.490873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 835/1665] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:18 2022] POST /identity/v3/projects => generated 403 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:18.491061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1bc-c4ac-41a9-972c-349438d49cdd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:18.493099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.634450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00914adc-2d89-4a0a-8db5-7ada94d455a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:18.643350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:18.644097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.644397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.644678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.646455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:18.652866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:18.662260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:18.663002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.666541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.676086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.746807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 836/1666] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:18 2022] POST /identity/v3/users => generated 308 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:18.750419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.773550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6fe5ee-2afd-446b-b3ea-4a1b12f8b2b7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:18.790163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:18.791568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.791568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.791568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.795663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:18.799791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:18.816954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:18.825138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:18.835338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 837/1667] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:18.839277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:18.844148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 831/1668] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:18.859857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:18.871923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78e62f-88b3-4eaf-a4c8-29538270dd09 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:18.885127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:18.886564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:18.886564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:18.886778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] PATH_INFO: `/v3/projects/a6e9e6bef7a74532ba435896848acdc0/users/8db4daf060404994891c0526a811ceaf/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:18.936343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e9e6bef7a74532ba435896848acdc0, user_id=8db4daf060404994891c0526a811ceaf, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:18.940485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:19.034400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 838/1669] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:18 2022] PUT /identity/v3/projects/a6e9e6bef7a74532ba435896848acdc0/users/8db4daf060404994891c0526a811ceaf/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:19.038663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:19.071890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2b40-9aa9-42ee-ac4e-c320319c8e50 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:19.182403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:19.183202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:19.183614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:19.183966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:19.184828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:19.186537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77263d4f-3642-42e8-8a88-eaefe118cccb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:19.218404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 832/1670] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:19.223327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:19.233349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:19.240746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f63b2c2-4d10-4a5b-a215-55e3906736cc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:19.252565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:19.253713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:19.254431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:19.254761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] PATH_INFO: `/v3/projects/a6e9e6bef7a74532ba435896848acdc0/users/8db4daf060404994891c0526a811ceaf/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:19.257859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e9e6bef7a74532ba435896848acdc0, user_id=8db4daf060404994891c0526a811ceaf, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:19.270971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:19.362581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 839/1671] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:19 2022] PUT /identity/v3/projects/a6e9e6bef7a74532ba435896848acdc0/users/8db4daf060404994891c0526a811ceaf/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:19.384860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:19.384860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:19.384860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:19.535334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] MFA Rules not processed for user `8db4daf060404994891c0526a811ceaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:19.542267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:19.834249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 833/1672] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:19.846201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:19.848082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.023075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:20.024980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.030192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cb15e-3a71-4d4f-9798-c5856bf99181 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:20.042891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:20.044887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.045192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.045478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.072508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:20.076018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:20.104760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 840/1673] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:19 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:20.245540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5604b4-d840-4111-bcf8-350b0a716548 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:20.261529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:20.266497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.266497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.266497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] PATH_INFO: `/v3/projects/88cc669910ae4278aa9d848f37762a49` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.266497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cc669910ae4278aa9d848f37762a49)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:20.269213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: WARNING py.warnings [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 18:21:20.269213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: warnings.warn(msg) Jul 12 18:21:20.269213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: Jul 12 18:21:20.272693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:20.442391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:20.479591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e25bd-6a99-46b7-8a18-ab54632ef343 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:20.512579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cc669910ae4278aa9d848f37762a49', 'request_id': 'req-f5289701-e1c6-48d1-a843-729c8c49ce73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:20.525002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cc669910ae4278aa9d848f37762a49', 'request_id': 'req-f5289701-e1c6-48d1-a843-729c8c49ce73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:20.602468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cc669910ae4278aa9d848f37762a49', 'request_id': 'req-f5289701-e1c6-48d1-a843-729c8c49ce73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:20.640366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] The token cache is being invalidate because project 88cc669910ae4278aa9d848f37762a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:20.640673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:20.654292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f5289701-e1c6-48d1-a843-729c8c49ce73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:20.655072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 834/1674] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:20 2022] DELETE /identity/v3/projects/88cc669910ae4278aa9d848f37762a49 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:20.663237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf6f6-bc4c-4d93-a690-5a2ffa45982f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.663561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf6f6-bc4c-4d93-a690-5a2ffa45982f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.673404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470bf6f6-bc4c-4d93-a690-5a2ffa45982f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.733109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:20.737710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.737710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.737710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] PATH_INFO: `/v3/users/d57cb317aa714e7d997ce9a8750b4430` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.741913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57cb317aa714e7d997ce9a8750b4430)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:20.743697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:20.746732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:20.753331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-470bf6f6-bc4c-4d93-a690-5a2ffa45982f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:20.754578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-470bf6f6-bc4c-4d93-a690-5a2ffa45982f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.775545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 835/1675] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:20.785686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f9a0-59c6-4df3-8f75-372f335966e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.786528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f9a0-59c6-4df3-8f75-372f335966e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.786987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854f9a0-59c6-4df3-8f75-372f335966e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.864772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6854f9a0-59c6-4df3-8f75-372f335966e1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:20.870526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6854f9a0-59c6-4df3-8f75-372f335966e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:20.901258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 836/1676] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:20.902775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefca50-c6e7-449d-9b06-31adc95ad746 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:20.914726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefca50-c6e7-449d-9b06-31adc95ad746 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:20.920304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefca50-c6e7-449d-9b06-31adc95ad746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:20.996238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ccefca50-c6e7-449d-9b06-31adc95ad746 None None] MFA Rules not processed for user `e146659a88964a23bc7113166311b943`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:20.999793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ccefca50-c6e7-449d-9b06-31adc95ad746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.019342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57cb317aa714e7d997ce9a8750b4430'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.069422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57cb317aa714e7d997ce9a8750b4430'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.144853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:21.146577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57cb317aa714e7d997ce9a8750b4430'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.253833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57cb317aa714e7d997ce9a8750b4430'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.254727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57cb317aa714e7d997ce9a8750b4430'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.262341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 841/1677] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:20 2022] DELETE /identity/v3/users/d57cb317aa714e7d997ce9a8750b4430 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:21.263764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:21.271217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.292734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 837/1678] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:21.294180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73abbb-5859-471b-93d4-debae465522d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.294564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73abbb-5859-471b-93d4-debae465522d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.294935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73abbb-5859-471b-93d4-debae465522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.325676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e73abbb-5859-471b-93d4-debae465522d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:21.326998 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e73abbb-5859-471b-93d4-debae465522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.417375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e251635e-5750-4d06-8ebe-b24f3cb1e88a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:21.440098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:21.443088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.443688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.443688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.456246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:21.459026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:21.463208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3bebe8-a728-4edc-83ab-3964e62b84bb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:21.480476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 842/1679] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:21.482320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.482822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.483394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.488753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:21.510413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] MFA Rules not processed for user `e146659a88964a23bc7113166311b943`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:21.516194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.557431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 838/1680] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:21.558674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73abbb-5859-471b-93d4-debae465522d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:21.564683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e73abbb-5859-471b-93d4-debae465522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.585531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73abbb-5859-471b-93d4-debae465522d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:21.599260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:21.600745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.601319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.601834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] PATH_INFO: `/v3/users/7f6e097dbb8e4403a735d0bab3e1b0bf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.603523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6e097dbb8e4403a735d0bab3e1b0bf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:21.607510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:21.635614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 843/1681] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:21.636755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:21.665669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7e0ca-a108-4b25-9988-3d698bb8f168 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:21.678863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:21.679908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.680407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.680913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.681909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:21.684434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:21.826412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 844/1682] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:21 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:21.827549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:21.833146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:21.867354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6e097dbb8e4403a735d0bab3e1b0bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.893444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6e097dbb8e4403a735d0bab3e1b0bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.906180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3ef39-1558-41e2-b7e7-35cdb19b12a8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:21.913576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6e097dbb8e4403a735d0bab3e1b0bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.926458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:21.928455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:21.928746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:21.930227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:21.995127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6e097dbb8e4403a735d0bab3e1b0bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:21.996363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6e097dbb8e4403a735d0bab3e1b0bf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:22.007155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 839/1683] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:21 2022] DELETE /identity/v3/users/7f6e097dbb8e4403a735d0bab3e1b0bf => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:22.008281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.010902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.029682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:22.057863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.058567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d070e-4394-4ef9-af29-a4c24493972b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.084104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 845/1684] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:22.086319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.086319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.086319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.141364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] MFA Rules not processed for user `c39a7058d0e1423f8d8464eb4c09e490`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:22.142923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.196193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1368765-fd03-4bd6-b1f3-5926414a9038 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.204677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.205366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.211027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.211369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.213400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.281657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 846/1685] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:22.285317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.287684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.381676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.385551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2f4f-23a9-42b5-a027-ba0e53f109a6 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.406764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 840/1686] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:22.410278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c36-49e2-4a96-a83b-e1eae5689011 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.411870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c36-49e2-4a96-a83b-e1eae5689011 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.411870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e8c36-49e2-4a96-a83b-e1eae5689011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.446400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a7632-4b69-40fd-b5e2-45df3b44d22e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.462783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be8e8c36-49e2-4a96-a83b-e1eae5689011 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:22.464658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.469385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.469385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.469385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.469385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.471671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be8e8c36-49e2-4a96-a83b-e1eae5689011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.471890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.481013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 841/1687] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:22.482981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116f14-147f-491d-bbc5-b6739ae2264b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.483492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116f14-147f-491d-bbc5-b6739ae2264b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.505795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45116f14-147f-491d-bbc5-b6739ae2264b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.560629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45116f14-147f-491d-bbc5-b6739ae2264b None None] MFA Rules not processed for user `c39a7058d0e1423f8d8464eb4c09e490`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:22.563081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45116f14-147f-491d-bbc5-b6739ae2264b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.584299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 842/1688] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:22.590158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.590158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.590158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.614592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 847/1689] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:22 2022] POST /identity/v3/users => generated 284 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:22.616290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.618047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.647123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] MFA Rules not processed for user `d1e1edac4a2f430ea534bf4911988d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:22.648175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.745596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256933d-99d7-4e02-97b5-2c5834016ebd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.751078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 843/1690] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:22.752078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.755900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:22.762697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.764309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.772232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.772759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.789959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c012a5a-6cc3-47fe-abc4-6ccd0a737acb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.794334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.796771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.801158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.802121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.802603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.803078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.813820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 848/1691] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:22.813820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.825593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418d43-b70f-413d-8681-37d1d253229d service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.826912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.829923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.837860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.838315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.838609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.838984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.839733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.842504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.845355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 844/1692] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:22.864143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 849/1693] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:22.864716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.880633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ad3af-350f-41d5-8cb1-96a4831ed4b3 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.886537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.887325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.887612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.887889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.888964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.890732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a447bff-2009-4395-82fb-8b12bfeb12a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:22.914035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:22.922004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 845/1694] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:22.927841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0490b-e373-4d29-9a94-66079629bcd4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:22.933269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:22.934287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:22.935093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:22.935609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] PATH_INFO: `/v3/projects/638992d3ca6544f9939e61aecae6570b/users/b2862feaad744e94853a93ed40905976/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:22.957962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638992d3ca6544f9939e61aecae6570b, user_id=b2862feaad744e94853a93ed40905976, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:22.959843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:23.106797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 850/1695] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:22 2022] PUT /identity/v3/projects/638992d3ca6544f9939e61aecae6570b/users/b2862feaad744e94853a93ed40905976/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:23.110474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.110769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.111339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.171766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] MFA Rules not processed for user `b2862feaad744e94853a93ed40905976`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:23.173639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.311052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:23.315046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.332571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 846/1696] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:23.359361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:23.363634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.517834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b505cac2-9be4-41c9-a545-7911648712ed None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:23.532372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:23.534288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.534732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.535212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.545499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d01e49-e703-4cc0-a6ff-ed578b708eb8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:23.549008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:23.550670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692f0ec-517c-4575-9705-965e617210e1 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:23.564338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 847/1697] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:23.566160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefde50-e57f-4268-8e9e-0103fafcf00f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.566588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefde50-e57f-4268-8e9e-0103fafcf00f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.567037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefde50-e57f-4268-8e9e-0103fafcf00f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.570048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 848/1698] 10.222.0.33 () {54 vars in 912 bytes} [Tue Jul 12 18:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:23.570934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:23.572582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.572870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.573151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] PATH_INFO: `/v3/projects/58b49eb7d47d4431a851f142b8e7d7d9` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.575060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b49eb7d47d4431a851f142b8e7d7d9)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:23.577234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:23.580932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6ea7-a2c0-434b-a1fe-00ec81400f7b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.582731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6ea7-a2c0-434b-a1fe-00ec81400f7b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.583010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991f6ea7-a2c0-434b-a1fe-00ec81400f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.684259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-991f6ea7-a2c0-434b-a1fe-00ec81400f7b None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:23.685593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-991f6ea7-a2c0-434b-a1fe-00ec81400f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.748369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b49eb7d47d4431a851f142b8e7d7d9', 'request_id': 'req-209f2033-7059-4734-a4d0-2536bb1612f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:23.767499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b49eb7d47d4431a851f142b8e7d7d9', 'request_id': 'req-209f2033-7059-4734-a4d0-2536bb1612f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:23.804794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 849/1699] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:23.807388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeccf2-65b6-4029-88ae-4a54b846c44b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.807790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeccf2-65b6-4029-88ae-4a54b846c44b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.808758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeccf2-65b6-4029-88ae-4a54b846c44b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.810469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 850/1700] 10.222.0.33 () {54 vars in 912 bytes} [Tue Jul 12 18:21:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:23.826835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:23.828087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:23.829343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:23.853705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b49eb7d47d4431a851f142b8e7d7d9', 'request_id': 'req-209f2033-7059-4734-a4d0-2536bb1612f7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:23.869114 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] The token cache is being invalidate because project 58b49eb7d47d4431a851f142b8e7d7d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:23.869462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:23.871530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:23.874317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 851/1701] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:23 2022] DELETE /identity/v3/projects/58b49eb7d47d4431a851f142b8e7d7d9 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:23.875411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:23.878330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:23.879839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.882116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:23.997763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:24.004305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209f2033-7059-4734-a4d0-2536bb1612f7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:24.011197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 851/1702] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:21:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:24.012230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:24.014541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.022108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:24.024369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.024369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.024551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.033028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.060025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:24.065490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:24.088157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 852/1703] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:24.090283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:24.097308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.111012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbcdfa-126c-41f4-8ec2-f543eb7293c7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:24.116965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:24.118233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.118650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.119074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] PATH_INFO: `/v3/users/8db4daf060404994891c0526a811ceaf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.121246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db4daf060404994891c0526a811ceaf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:24.123326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:24.129760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acbda0b-15d3-41c3-a90a-b7ec4a8b006b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:24.142987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:24.143836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.144245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.144766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.165576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:24.169370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:24.182019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 853/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:24.183386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:24.185371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.205856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4f659-de33-4713-9de5-0023deecc410 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:24.212927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:24.213947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.214237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.214515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] PATH_INFO: `/v3/projects/a725964ffc85455eb6387c70df67a800` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.215851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a725964ffc85455eb6387c70df67a800)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:24.221039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:24.450923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:24.472613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db4daf060404994891c0526a811ceaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.484886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a725964ffc85455eb6387c70df67a800', 'request_id': 'req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.491534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db4daf060404994891c0526a811ceaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.498785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a725964ffc85455eb6387c70df67a800', 'request_id': 'req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.500105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db4daf060404994891c0526a811ceaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.600854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a725964ffc85455eb6387c70df67a800', 'request_id': 'req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.616335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] The token cache is being invalidate because project a725964ffc85455eb6387c70df67a800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:24.616725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.617419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.621031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 854/1705] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:24 2022] DELETE /identity/v3/projects/a725964ffc85455eb6387c70df67a800 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:24.624827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:24.627256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.678257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db4daf060404994891c0526a811ceaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.680393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca6a90e2-7960-4867-9fcc-3de343ad7efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db4daf060404994891c0526a811ceaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:24.689841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 852/1706] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:24 2022] DELETE /identity/v3/users/8db4daf060404994891c0526a811ceaf => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:24.695528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40b4-2398-45c6-94f1-29dacd048fb8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.695830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40b4-2398-45c6-94f1-29dacd048fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.696133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e40b4-2398-45c6-94f1-29dacd048fb8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.703049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 853/1707] 10.222.0.33 () {54 vars in 960 bytes} [Tue Jul 12 18:21:24 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:24.728368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:24.730026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:24.730344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:24.788669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:24.791904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:24.795656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b1ec57-3d00-4cca-a8ef-a84bbef359e0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:25.004787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 854/1708] 10.222.0.33 () {58 vars in 1057 bytes} [Tue Jul 12 18:21:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:25.005932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:25.007645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:25.034447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79634ea3-0eba-4e18-af8a-b9749442f16f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:25.042387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:25.043187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:25.044426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:25.044748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:25.047425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:25.055877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:25.057637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:25.058316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:25.059217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] PATH_INFO: `/v3/users/478f4eaba5bf416da87774316c492fc5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:25.069671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=478f4eaba5bf416da87774316c492fc5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:25.070037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:25.070037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:25.071844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:25.125175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 855/1709] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:25.127221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:25.139617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fb570-9a12-403f-a40a-ac550567826c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:25.147670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:25.148642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:25.149048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:25.149419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:25.166481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:25.168306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6570-7abe-460d-9e3f-bb425f156823 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:25.237181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 856/1710] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:25.249264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512291b-9950-4c46-af3f-e4a4b38d4a03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:25.249264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512291b-9950-4c46-af3f-e4a4b38d4a03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:25.249264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512291b-9950-4c46-af3f-e4a4b38d4a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:25.305128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1512291b-9950-4c46-af3f-e4a4b38d4a03 None None] MFA Rules not processed for user `50724984775d4248a5975459d8c2c76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:25.309600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1512291b-9950-4c46-af3f-e4a4b38d4a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:25.342148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478f4eaba5bf416da87774316c492fc5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:25.394556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478f4eaba5bf416da87774316c492fc5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:25.416865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478f4eaba5bf416da87774316c492fc5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:25.444746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 857/1711] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:25.446416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b08676-e371-4f7c-bb39-7d75622148da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:25.446801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b08676-e371-4f7c-bb39-7d75622148da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:25.447173 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b08676-e371-4f7c-bb39-7d75622148da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:25.515099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478f4eaba5bf416da87774316c492fc5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:25.516072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478f4eaba5bf416da87774316c492fc5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:25.525965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 855/1712] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:24 2022] DELETE /identity/v3/users/478f4eaba5bf416da87774316c492fc5 => generated 0 bytes in 901 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:25.530388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-69b08676-e371-4f7c-bb39-7d75622148da None None] MFA Rules not processed for user `c39a7058d0e1423f8d8464eb4c09e490`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:25.532098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69b08676-e371-4f7c-bb39-7d75622148da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:25.679650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 858/1713] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:26.639518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:26.641214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:26.843782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf4fe2-4973-4102-a464-41ca29592a58 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:26.858821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:26.872935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:26.873576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:26.874126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] PATH_INFO: `/v3/projects/a6e9e6bef7a74532ba435896848acdc0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:26.876315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e9e6bef7a74532ba435896848acdc0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:26.879544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:26.973397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:27.085550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e9e6bef7a74532ba435896848acdc0', 'request_id': 'req-941b112f-ddd4-4c7c-b85a-37bd994b5541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.099713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e9e6bef7a74532ba435896848acdc0', 'request_id': 'req-941b112f-ddd4-4c7c-b85a-37bd994b5541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.288999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e9e6bef7a74532ba435896848acdc0', 'request_id': 'req-941b112f-ddd4-4c7c-b85a-37bd994b5541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.306736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] The token cache is being invalidate because project a6e9e6bef7a74532ba435896848acdc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:27.306736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.308717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.313579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 856/1714] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:26 2022] DELETE /identity/v3/projects/a6e9e6bef7a74532ba435896848acdc0 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:27.320994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e586-60dd-4856-83fd-d2aeccc9643e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.321457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e586-60dd-4856-83fd-d2aeccc9643e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.321457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e586-60dd-4856-83fd-d2aeccc9643e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.351803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa62e586-60dd-4856-83fd-d2aeccc9643e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:27.353040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa62e586-60dd-4856-83fd-d2aeccc9643e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.357024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:27.397435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:27.399680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.507805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 859/1715] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:27.522599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.525690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.526240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.547099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b112f-ddd4-4c7c-b85a-37bd994b5541 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:27.566428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:27.566428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.566428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.566428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] PATH_INFO: `/v3/projects/b9cd92984f6645fca37484f94988c988` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.568983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cd92984f6645fca37484f94988c988)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:27.571123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:27.598539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:27.607325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:27.639799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 860/1716] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:27.642764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:27.670454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf21522-a702-4fbf-9abe-c177b989f7df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:27.697537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:27.697537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.697537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.697537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.698012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:27.698012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:27.704554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:27.738491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 861/1717] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:27.739393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:27.758615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d4f8-7dad-4749-9725-dca00d8cc34a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:27.779492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:27.780384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:27.780675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:27.781003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:27.781773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:27.784398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:27.889099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cd92984f6645fca37484f94988c988', 'request_id': 'req-4f021530-300e-4418-94c1-76256ab03144'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.908531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cd92984f6645fca37484f94988c988', 'request_id': 'req-4f021530-300e-4418-94c1-76256ab03144'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:27.982654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 862/1718] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:27 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:27.987114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.049650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cd92984f6645fca37484f94988c988', 'request_id': 'req-4f021530-300e-4418-94c1-76256ab03144'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:28.070648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] The token cache is being invalidate because project b9cd92984f6645fca37484f94988c988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:28.071072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:28.075364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4f021530-300e-4418-94c1-76256ab03144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:28.083342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 857/1719] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:27 2022] DELETE /identity/v3/projects/b9cd92984f6645fca37484f94988c988 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:28.086678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e94d-ead3-4f02-aeed-f2ff67482d0e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.086971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e94d-ead3-4f02-aeed-f2ff67482d0e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.087405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205e94d-ead3-4f02-aeed-f2ff67482d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.185345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c205e94d-ead3-4f02-aeed-f2ff67482d0e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:28.186772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c205e94d-ead3-4f02-aeed-f2ff67482d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:28.329834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d511d-4561-457a-8c3e-6f701a8e4850 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.369254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.370002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.370288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.370568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.377313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.381545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.456996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 858/1720] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:28.460916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.461899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.462391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.489214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:28.490714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:28.500965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 859/1721] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:28.505276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.518051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2b26a5-5abe-41ec-b8ad-e652aa4d73e5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.523727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.525743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.526707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.527142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.529219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:28.529706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.531568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.553771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 860/1722] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:21:28.553771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.564452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2630a59-dea6-4205-9c36-3f6fa8c7b74c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.574251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:28.586644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 863/1723] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:27 2022] POST /identity/v3/users => generated 288 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:28.587588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.588221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.589565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.591646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:28.592178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.592615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.594303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.597685 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.619595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54379bc3-6409-4d26-b794-46027139c4e1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.628648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.629832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.630378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.630806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.632458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.635756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.652895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 864/1724] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:28.656872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.676256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef131674-7c4d-4085-94e3-79c5e30c2d87 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.684873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.685558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.685978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.686260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.687167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.688919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.710320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 865/1725] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:28.722616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 861/1726] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:28 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:28.722786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.724106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:28.771176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b62e44-8892-4330-a6d7-cf6540f1c859 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.928145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53027f9-0ac1-46eb-b525-4198698b8a0d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:28.944199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:28.945220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:28.945549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:28.945830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:28.948777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:28.952367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:28.999239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.000526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.001407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.001693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] PATH_INFO: `/v3/projects/543421201e684cffb984420db266ac70/users/cdf3fb2a409b43faba4a3c640e2271e8/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.056711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=543421201e684cffb984420db266ac70, user_id=cdf3fb2a409b43faba4a3c640e2271e8, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.059715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddaacdc-4958-4dc7-a079-ac945ba47650 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.087386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 862/1727] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:28 2022] POST /identity/v3/users => generated 283 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:29.092274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.142113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153638-2b79-49dd-abe2-9a2150c7e2c7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.157467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.158168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.158456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.158737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.159476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.162892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.184516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 866/1728] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:28 2022] PUT /identity/v3/projects/543421201e684cffb984420db266ac70/users/cdf3fb2a409b43faba4a3c640e2271e8/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:29.190281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.190796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.192616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.232511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 863/1729] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:29.233728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.255072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d6eca-5afe-4a5b-a2af-bd5b076d2961 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.337411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] MFA Rules not processed for user `cdf3fb2a409b43faba4a3c640e2271e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:29.343442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:29.357803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:29.474321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.475018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.475377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.475546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.476318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.481474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.499184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 864/1730] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:29.500103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.510710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b066-e7b7-4596-a25c-2331d49721dd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.515675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 867/1731] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:29.519590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.520474 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.520829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.521150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] PATH_INFO: `/v3/projects/8c6d806c668b4e698b93161eb3ce1199/users/04f7abb78308462aa48e2fe9f812a04d/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.521457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.537112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c624c2fc-8ed8-4b5e-afe4-ec5677cf106e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.538814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6d806c668b4e698b93161eb3ce1199, user_id=04f7abb78308462aa48e2fe9f812a04d, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.542003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248afb5d-0365-41c6-a264-f348199bd46b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.543270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.544359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.544976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.545412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.546514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.549371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.634918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:29.642105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 865/1732] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:29 2022] PUT /identity/v3/projects/8c6d806c668b4e698b93161eb3ce1199/users/04f7abb78308462aa48e2fe9f812a04d/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:29.652648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.652959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.653328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.683995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 868/1733] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:29.688001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.694011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] MFA Rules not processed for user `04f7abb78308462aa48e2fe9f812a04d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:29.694011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:29.835347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182afb1-deac-4939-8a7c-054496893c5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.845821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.846846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.847234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.847624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.848461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.851371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.852785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 866/1734] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:29.861201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.879156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb254c9-9899-41b6-847f-e93fe520ec55 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.891902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.893030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.893581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.894104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.895338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.897678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:29.962787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 869/1735] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:29.966992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:29.977524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1100b7-ade7-4d14-a489-813e21ce03cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:29.988328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:29.989251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:29.989547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:29.989829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:29.990576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:29.992298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.009904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 870/1736] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:30.010938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.028468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 867/1737] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:29 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:30.037272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.045477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecbbda9-0de8-4e63-84df-f3574200d01d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.196571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.196571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.196571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.196571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] PATH_INFO: `/v3/projects/2f43ef3ceec043e1b8724eef76253fcd/users/3838e648293b4b51a9fbbf99e3959765/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.212432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f43ef3ceec043e1b8724eef76253fcd, user_id=3838e648293b4b51a9fbbf99e3959765, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.215829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.268714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356deb00-f11d-4488-a30e-9680eba11bdc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.303902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.304392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.311262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.311262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.311262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.311262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.317620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 871/1738] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:30 2022] PUT /identity/v3/projects/2f43ef3ceec043e1b8724eef76253fcd/users/3838e648293b4b51a9fbbf99e3959765/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:30.321656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.430288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e575b-0513-4906-9f09-47fa6a3b8dde admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.437322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.438395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.438924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.439600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.440663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.443857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.479974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 872/1739] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:30.481564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.500353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 868/1740] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:30 2022] POST /identity/v3/users => generated 288 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:30.503803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.529074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df62640-fbd2-401b-b0a3-393d1da6a7d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.540778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3064d-e75e-4326-b746-460e9dd752cb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.542744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.544603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.544890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.545170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] PATH_INFO: `/v3/projects/2f43ef3ceec043e1b8724eef76253fcd/users/3838e648293b4b51a9fbbf99e3959765/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.551345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f43ef3ceec043e1b8724eef76253fcd, user_id=3838e648293b4b51a9fbbf99e3959765, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.572968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.573678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.573965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.574244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.574997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:30.585462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.590223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7dc8f-d166-4a85-bda7-2f39597dea58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:30.627690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 873/1741] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:30 2022] PUT /identity/v3/projects/2f43ef3ceec043e1b8724eef76253fcd/users/3838e648293b4b51a9fbbf99e3959765/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:30.632886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.636401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.636401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:30.646799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 869/1742] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:30 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:30.653327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:30.693687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371d27c-7207-4922-b583-9d1dda000675 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:30.694718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] MFA Rules not processed for user `3838e648293b4b51a9fbbf99e3959765`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:30.698963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:30.929108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 874/1743] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:30 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:30.953120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:30.955124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:30.955718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:30.956180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] PATH_INFO: `/v3/projects/08e4003427a54bcfb59bcee1bd213496/users/5528b80ad3534b4d80f2c217fb86d54d/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:31.013120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e4003427a54bcfb59bcee1bd213496, user_id=5528b80ad3534b4d80f2c217fb86d54d, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:31.015742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:31.121020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:31.123016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:31.142467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 870/1744] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:30 2022] PUT /identity/v3/projects/08e4003427a54bcfb59bcee1bd213496/users/5528b80ad3534b4d80f2c217fb86d54d/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:31.146087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:31.270085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1632c8c9-2ce4-43f5-a062-6f6ebe770861 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:31.313063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:31.340966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5eaffa-69e0-41c6-bdf0-d16e1063b790 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:31.347576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:31.348405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:31.348706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:31.348990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:31.349731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:31.351354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:31.391977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:31.392834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:31.393120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:31.393401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:31.423275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 871/1745] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:31.426154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:31.445220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085bf3d-64b2-40c3-814d-1a3273e9143f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:31.462061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:31.463092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:31.463459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:31.463811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] PATH_INFO: `/v3/projects/08e4003427a54bcfb59bcee1bd213496/users/5528b80ad3534b4d80f2c217fb86d54d/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:31.470165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08e4003427a54bcfb59bcee1bd213496, user_id=5528b80ad3534b4d80f2c217fb86d54d, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:31.473960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5c1e6-1e7d-43dd-8a67-ae00dfc3ee0d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:31.512296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 872/1746] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:31 2022] PUT /identity/v3/projects/08e4003427a54bcfb59bcee1bd213496/users/5528b80ad3534b4d80f2c217fb86d54d/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:31.519538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:31.519833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:31.520384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:31.580436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] MFA Rules not processed for user `5528b80ad3534b4d80f2c217fb86d54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:31.581897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:31.582907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:31.584502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b5994-56e5-4a51-80be-a682a46b31df service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:31.619753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 875/1747] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:31.755647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 873/1748] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:31.908816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:31.909564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:31.910024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.037490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:32.039106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:32.158344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:32.160088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:32.196159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 876/1749] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:21:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:32.322716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e672592b-88ef-4d71-a34c-ac7c0fd2d7fd None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:32.332152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:32.334421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.334630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.336266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.358932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:32.361308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:32.380399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 874/1750] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:32.499717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:32.695895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:32.699158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:32.891534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:32.906436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c3917-188b-469b-955d-d467ceeadec2 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:32.908236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29979af5-948a-4461-b8b7-5d79f0e086d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:32.917226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:32.918747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.919897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:32.921240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:32.921742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.922186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.940334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:32.942131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b9c56-46d5-455b-a0b7-026d2ca1ac4d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:32.950936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:32.954476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:32.979848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 877/1751] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:21:33.282613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:33.285692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:33.343490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 875/1752] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:34.768170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:34.768758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:34.768758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:34.797050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:34.799421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:34.814319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:34.915151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 878/1753] 10.222.0.58 () {58 vars in 1015 bytes} [Tue Jul 12 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:35.001368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:35.003370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.094160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:35.096668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:35.098891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.103358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761548f5-eb29-4451-b761-e678d5b73fd6 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:35.115196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4253b9f-a97c-47b5-9aed-b6da78cbbcee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:35.124037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:35.127379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.127379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.127379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.139759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:35.140470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.144920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:35.145167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.145167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.145347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:35.155410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 879/1754] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:35.181553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:35.185357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:35.198215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:35.220718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587b25-5510-4086-a735-61ecfa240202 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:35.224206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 876/1755] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:35.235969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:35.236292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.237536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.238175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.248558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:35.251440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766a4e-a715-4767-b0a5-010cb8c7f563 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:35.313390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 880/1756] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:35.433224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:35.434933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:35.702818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bc77f9-deeb-4c9d-b043-d4fe1fc80513 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:35.720568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:35.725169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:35.725882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:35.727709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] PATH_INFO: `/v3/users/5a2a4a1b6593473f8b0520d50b35abbc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:35.730895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2a4a1b6593473f8b0520d50b35abbc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:35.734443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:36.235536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2a4a1b6593473f8b0520d50b35abbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:36.274467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2a4a1b6593473f8b0520d50b35abbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:36.303025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2a4a1b6593473f8b0520d50b35abbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:36.568800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2a4a1b6593473f8b0520d50b35abbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:36.568800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2a4a1b6593473f8b0520d50b35abbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:36.575670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 877/1757] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:35 2022] DELETE /identity/v3/users/5a2a4a1b6593473f8b0520d50b35abbc => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:36.581664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:36.583399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:36.584045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:36.622213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:36.628239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:36.681936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:36.684143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:36.777450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:36.946601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 881/1758] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:36.947352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35d162-489b-4ae5-a022-ab5dffa83c43 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:36.947436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:36.947436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:36.958592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:36.960228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:36.960562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:36.960857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:36.968218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:37.127280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da949936-3297-44c7-83e2-5768b9b93a55 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:37.139008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:37.144871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:37.153382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:37.154532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:37.183956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:37.186594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f406f3-896f-4615-922d-dea84f045f31 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:37.214366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 882/1759] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:37.229240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:37.231502 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b3b6c-4e42-4dda-a29c-8af29eeaf0ff service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:37.261581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 878/1760] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:37.693975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:38.160259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:38.161475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:38.162140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:38.164046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 883/1761] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:38.234657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:38.236387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:38.236831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:38.270905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:38.274563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:38.545856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 879/1762] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:38.944345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:38.949028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:39.015060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2107c9-2a9f-47fe-b353-8e2c005db102 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:39.047623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:39.050654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:39.056229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:39.056229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:39.074817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:39.079219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc050b-a7e9-4444-acc4-ab07eed1c8e9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:39.098554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 884/1763] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:39.396408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:39.671263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:39.676041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:39.721447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a526720-34bd-410f-a8b7-b270018fbaad None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:39.738048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:39.739256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:39.739715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:39.740187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] PATH_INFO: `/v3/users/04f7abb78308462aa48e2fe9f812a04d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:39.749008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f7abb78308462aa48e2fe9f812a04d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:39.751518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:40.180440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f7abb78308462aa48e2fe9f812a04d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:40.217664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f7abb78308462aa48e2fe9f812a04d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:40.229050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f7abb78308462aa48e2fe9f812a04d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:40.334435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f7abb78308462aa48e2fe9f812a04d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:40.336637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f7abb78308462aa48e2fe9f812a04d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:40.374352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 880/1764] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:39 2022] DELETE /identity/v3/users/04f7abb78308462aa48e2fe9f812a04d => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:40.374509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.374509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.374509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.428147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:40.433977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.483937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:40.486492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.603727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 885/1765] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:40.610016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9dc783-2c4e-4c0d-a3c7-87dbcf9054a3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:40.615641 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:40.617616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.618186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.619095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] PATH_INFO: `/v3/projects/7bddc698ee56403a9f53fbd45d277dbc` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.620992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bddc698ee56403a9f53fbd45d277dbc)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:40.623644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:40.630244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:40.631883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:40.778147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacabbe-0670-4329-86c5-ce21c55d4443 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:40.784844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:40.786648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:40.787179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:40.787611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:40.807083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:40.813127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d168646-3376-4af5-8355-d47d736604d4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:40.837587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 886/1766] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:41.106162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bddc698ee56403a9f53fbd45d277dbc', 'request_id': 'req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:41.114855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bddc698ee56403a9f53fbd45d277dbc', 'request_id': 'req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:41.283711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741f64-f189-47b3-87ad-2597724166c2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:41.284047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741f64-f189-47b3-87ad-2597724166c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:41.284719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8741f64-f189-47b3-87ad-2597724166c2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:41.286982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 887/1767] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:21:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:21:41.305401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:41.305712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:41.305997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:41.350898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:41.377466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:41.405850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bddc698ee56403a9f53fbd45d277dbc', 'request_id': 'req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:41.437364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] The token cache is being invalidate because project 7bddc698ee56403a9f53fbd45d277dbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:41.444891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:41.444891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:41.444891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 881/1768] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:40 2022] DELETE /identity/v3/projects/7bddc698ee56403a9f53fbd45d277dbc => generated 0 bytes in 961 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:41.457791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:41.483642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:41.659546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 888/1769] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:41.660612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:41.666826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5fc84-ba1a-46b8-8c7f-e8c2a2029073 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:41.677873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:41.688536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:41.689439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:41.690081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:41.690895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] PATH_INFO: `/v3/users/5056cf27a20f43a4afb2a4fee57aef6b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:41.692347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5056cf27a20f43a4afb2a4fee57aef6b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:41.695468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:41.711839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b955d5-ec2f-4d2c-a493-48bd2d2b70e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:41.730619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:41.732673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:41.732673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:41.732965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] PATH_INFO: `/v3/users/b2862feaad744e94853a93ed40905976` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:41.734409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2862feaad744e94853a93ed40905976)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:41.754059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:41.979933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5056cf27a20f43a4afb2a4fee57aef6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.011257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5056cf27a20f43a4afb2a4fee57aef6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.022830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5056cf27a20f43a4afb2a4fee57aef6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.067555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2862feaad744e94853a93ed40905976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.103848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2862feaad744e94853a93ed40905976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.118712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2862feaad744e94853a93ed40905976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.423348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5056cf27a20f43a4afb2a4fee57aef6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.424615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5b5d3666-1ad0-4d84-ac07-968ede59eb57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5056cf27a20f43a4afb2a4fee57aef6b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.444026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 882/1770] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:41 2022] DELETE /identity/v3/users/5056cf27a20f43a4afb2a4fee57aef6b => generated 0 bytes in 986 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:42.487367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2862feaad744e94853a93ed40905976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.488220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2862feaad744e94853a93ed40905976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:42.495648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 889/1771] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:41 2022] DELETE /identity/v3/users/b2862feaad744e94853a93ed40905976 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:42.504980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:42.505288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:42.505733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:42.544052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:42.549662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:42.677660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 883/1772] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:42.773287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:42.785107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:42.910160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e5d2e-a572-4b0c-8c54-27b161f9bf02 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:42.917954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:42.918880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:42.919278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:42.919697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:42.952039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:42.955429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:42.958226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:42.967502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:42.984614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 890/1773] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:43.168924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5903-433f-445e-ac99-c9137cf39042 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:43.189726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:43.191957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:43.191957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:43.191957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:43.204506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:43.232780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:43.235467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:43.264571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 884/1774] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:43.497878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:44.050186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:44.050186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.050186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba24ef-a162-4af6-bbbd-8784e23bd8a7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:44.050798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:44.050798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.050798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.050798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] PATH_INFO: `/v3/projects/8c6d806c668b4e698b93161eb3ce1199` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.051554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6d806c668b4e698b93161eb3ce1199)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:44.054215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:44.234564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:44.235893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:44.235893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.263082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b72645-5294-459a-9a51-632eca11ed53 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:44.276812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:44.278717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.279647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.280156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] PATH_INFO: `/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.281726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f74a83d3cdd4efe9f80d86074cf6a78)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:44.283933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:44.325773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6d806c668b4e698b93161eb3ce1199', 'request_id': 'req-d025ae21-03f7-4079-ae20-78519cb6011d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.336094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6d806c668b4e698b93161eb3ce1199', 'request_id': 'req-d025ae21-03f7-4079-ae20-78519cb6011d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.491384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6d806c668b4e698b93161eb3ce1199', 'request_id': 'req-d025ae21-03f7-4079-ae20-78519cb6011d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.500535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f74a83d3cdd4efe9f80d86074cf6a78', 'request_id': 'req-7dce8da3-ad7b-4240-81db-595181bc8d3e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.510005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] The token cache is being invalidate because project 8c6d806c668b4e698b93161eb3ce1199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:44.510301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.516330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f74a83d3cdd4efe9f80d86074cf6a78', 'request_id': 'req-7dce8da3-ad7b-4240-81db-595181bc8d3e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.516432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.516432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 891/1775] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:44 2022] DELETE /identity/v3/projects/8c6d806c668b4e698b93161eb3ce1199 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:44.520068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:44.525029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.636197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f74a83d3cdd4efe9f80d86074cf6a78', 'request_id': 'req-7dce8da3-ad7b-4240-81db-595181bc8d3e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.649692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] The token cache is being invalidate because project 5f74a83d3cdd4efe9f80d86074cf6a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:44.650355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.651582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7dce8da3-ad7b-4240-81db-595181bc8d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:44.654731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 885/1776] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:44 2022] DELETE /identity/v3/projects/5f74a83d3cdd4efe9f80d86074cf6a78 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:44.662108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad856-76f6-4e55-9da2-a586090baa0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.662425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad856-76f6-4e55-9da2-a586090baa0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.662680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fad856-76f6-4e55-9da2-a586090baa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.685761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025ae21-03f7-4079-ae20-78519cb6011d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:44.688293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b9fad856-76f6-4e55-9da2-a586090baa0c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:44.689007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b9fad856-76f6-4e55-9da2-a586090baa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.821898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 886/1777] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:44.822468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:44.822468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.822468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.822468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] PATH_INFO: `/v3/users/5528b80ad3534b4d80f2c217fb86d54d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.823368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5528b80ad3534b4d80f2c217fb86d54d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:44.823368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:44.823532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.823532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.823532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.832703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:44.833925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.851376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 887/1778] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:44.851376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:44.851376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:44.868180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f315e564-493a-46ce-9307-ce2da7694022 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:44.873595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:44.874536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:44.874778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:44.875592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] PATH_INFO: `/v3/projects/638992d3ca6544f9939e61aecae6570b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:44.876965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638992d3ca6544f9939e61aecae6570b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:44.878993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:45.204712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638992d3ca6544f9939e61aecae6570b', 'request_id': 'req-8db3e862-80ed-4165-944c-bd9268210521'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.208443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5528b80ad3534b4d80f2c217fb86d54d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.214103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638992d3ca6544f9939e61aecae6570b', 'request_id': 'req-8db3e862-80ed-4165-944c-bd9268210521'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.229137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5528b80ad3534b4d80f2c217fb86d54d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.242444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5528b80ad3534b4d80f2c217fb86d54d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.405325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638992d3ca6544f9939e61aecae6570b', 'request_id': 'req-8db3e862-80ed-4165-944c-bd9268210521'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.405325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] The token cache is being invalidate because project 638992d3ca6544f9939e61aecae6570b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:45.405325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.405325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.405325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 888/1779] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:44 2022] DELETE /identity/v3/projects/638992d3ca6544f9939e61aecae6570b => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:45.405774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.405774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.470778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db3e862-80ed-4165-944c-bd9268210521 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.476686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.477383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.477760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.478359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.479107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:45.479422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.481266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea12fa7-94c8-4c29-9993-af05ec10408a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:45.497918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 889/1780] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:45.497918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.497918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.497918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.515999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:45.517252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.525830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 890/1781] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:45.526695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.542053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ad82a-16d3-48e8-8e32-4af68547dcc8 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.547941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.551578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.551578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.551578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.551578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.552469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:45.559848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5528b80ad3534b4d80f2c217fb86d54d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.561357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-179cf276-c6fb-4fac-9dab-3754ee37a1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5528b80ad3534b4d80f2c217fb86d54d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:45.567300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 892/1782] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:44 2022] DELETE /identity/v3/users/5528b80ad3534b4d80f2c217fb86d54d => generated 0 bytes in 1048 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:45.574699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.574699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.574699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.603177 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:45.604756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.700925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 891/1783] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/projects => generated 367 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:45.702001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.704985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:45.728322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 893/1784] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:45.731959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.756003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d574ee-06bd-44c2-8010-11129ca820e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.853595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.855938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.856479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.856961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.858263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:45.858825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.860788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:45.863308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec014aa5-b16f-4e3f-a34a-2658b9be48eb admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.868456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.869232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.870215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.870215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.871593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.873747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:45.882476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 894/1785] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:21:45.890054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:45.901567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d1be8-01aa-4ce9-8a9c-799b0e843f3e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:45.907236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:45.907898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:45.908292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:45.908605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:45.909608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:45.911856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.164492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 892/1786] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/users => generated 284 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:46.165678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.166926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 895/1787] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:45 2022] POST /identity/v3/projects => generated 371 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:46.170495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.180533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1defb6-7647-4697-bae1-9b623956e173 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.264378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4f26e-c5e4-4046-aab3-6506b8fc808e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.266014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.266768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.267058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.267413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.268144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.273482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.276987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.277647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.277934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.278410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.279242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.280889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.299946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 896/1788] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:46.301623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.317614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d58de-1709-436e-ab49-aa5390baceea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.322548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.323274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.323566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.323848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.324810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.326489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.340305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 897/1789] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:46.342897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.353127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8ba46-da8f-44d8-ae34-f04b28be2fad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.358161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.359056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.359366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.359645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] PATH_INFO: `/v3/projects/e3809e409c554d9ba4f02b52407fba6b/users/a92eaf0b35e945be89d8fc69b0971478/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.377047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3809e409c554d9ba4f02b52407fba6b, user_id=a92eaf0b35e945be89d8fc69b0971478, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.379751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c18a9-e088-4dfc-beea-9ff514609cce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.416662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 893/1790] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:46 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:46.422045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.436623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bc6f0-16cf-4c4c-8e0a-871b982dd954 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.440724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.441552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.441942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.442383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.443231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.445188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.457021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 894/1791] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:46.461084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.477733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2cce4a-c9cd-4eee-8d7d-4a908fb94b2b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.482958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.483682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.483976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.492653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.492653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.492653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.507954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 895/1792] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:46.509295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.521440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88223ead-38be-4ec6-8240-723c94e2e310 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.526273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.527248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.527603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.527948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] PATH_INFO: `/v3/projects/f7f8b8169b8841b79380b8779bfd727f/users/18a489ddbb54401aaf0e5cfce43f486c/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.539022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 898/1793] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:46 2022] PUT /identity/v3/projects/e3809e409c554d9ba4f02b52407fba6b/users/a92eaf0b35e945be89d8fc69b0971478/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:46.544837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7f8b8169b8841b79380b8779bfd727f, user_id=18a489ddbb54401aaf0e5cfce43f486c, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.547597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.551081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.551527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.551910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.585647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] MFA Rules not processed for user `a92eaf0b35e945be89d8fc69b0971478`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:46.586493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:46.660566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 899/1794] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:46.661804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.663042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:46.676552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 896/1795] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:46 2022] PUT /identity/v3/projects/f7f8b8169b8841b79380b8779bfd727f/users/18a489ddbb54401aaf0e5cfce43f486c/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:46.679795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.733247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3bc48-7288-4241-822e-1340b625dfe3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.738347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb1ade-4ed9-428d-8ab6-6656ddab8caa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:46.741654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.741654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.741654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.741654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] PATH_INFO: `/v3/projects/08e4003427a54bcfb59bcee1bd213496` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.742014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08e4003427a54bcfb59bcee1bd213496)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.743137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.743729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:46.744423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.744715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.745197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.745716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:46.747687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5921d09-4fbb-4646-b775-cdc7f96d88be admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:46.784231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:46.867081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 897/1796] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:46 2022] POST /identity/v3/projects => generated 369 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:46.870728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553152e-665b-487d-8539-1b2fd9b80d48 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:46.871103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553152e-665b-487d-8539-1b2fd9b80d48 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:46.871401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553152e-665b-487d-8539-1b2fd9b80d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:46.883660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08e4003427a54bcfb59bcee1bd213496', 'request_id': 'req-0f6debc7-c836-4444-80c8-b28d3adcc804'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:46.890510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08e4003427a54bcfb59bcee1bd213496', 'request_id': 'req-0f6debc7-c836-4444-80c8-b28d3adcc804'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:46.899838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0553152e-665b-487d-8539-1b2fd9b80d48 None None] MFA Rules not processed for user `18a489ddbb54401aaf0e5cfce43f486c`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:46.901124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0553152e-665b-487d-8539-1b2fd9b80d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:46.967880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08e4003427a54bcfb59bcee1bd213496', 'request_id': 'req-0f6debc7-c836-4444-80c8-b28d3adcc804'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:46.988560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] The token cache is being invalidate because project 08e4003427a54bcfb59bcee1bd213496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:46.988752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:46.990623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:46.993781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 900/1797] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:46 2022] DELETE /identity/v3/projects/08e4003427a54bcfb59bcee1bd213496 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:46.998219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:46.999676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:47.006827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 898/1798] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:47.019381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.019381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.019381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.033119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:47.034775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:47.086805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6debc7-c836-4444-80c8-b28d3adcc804 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.106215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 899/1799] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:47.107861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.110517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:47.124076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30263b7-3e7a-43ec-af40-7034c7ae989c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.128897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.129757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.129865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.130141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.131082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.133013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9d815-1c0a-41ee-8873-7cba956e5c9c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.151803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.152517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.152862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.153120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.153910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.155865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.242400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 900/1800] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:47.243777 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.244076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.244453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.253651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 901/1801] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:46 2022] POST /identity/v3/users => generated 291 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:47.254641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.263112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:47.264348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:47.264512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30482cab-40c7-454e-9a14-fe04a11e3959 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.320031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.320744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.321031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.321306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.322048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.323354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 901/1802] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:47.323982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.324235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.333901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfcc9c-403e-4d44-add2-ff7e9a346068 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.338557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.339205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.339486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.339758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.340509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.342126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.352639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 902/1803] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:47.353469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.362848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4d7ad3-9826-410f-a9b4-180f5d1b16c1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.367562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.368237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.368529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.368810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.369531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:47.369833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.371487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.383374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 903/1804] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:47.384265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.393929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a09b16-e88d-4fef-a077-382f4f098f53 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.398635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.401009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.401009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.401009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] PATH_INFO: `/v3/projects/0d24228c888a436aa035fde7b43bbeeb/users/afb0dfe6ed574d6087ebaf618e0853b8/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.402036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 902/1805] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:47.402899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.414759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7aebd5-5762-42f2-ac47-689f6cf04900 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.415576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d24228c888a436aa035fde7b43bbeeb, user_id=afb0dfe6ed574d6087ebaf618e0853b8, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.418404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.419844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.420188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.420576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.420748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.421437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.423326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.471111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 904/1806] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:47 2022] PUT /identity/v3/projects/0d24228c888a436aa035fde7b43bbeeb/users/afb0dfe6ed574d6087ebaf618e0853b8/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:47.472050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.548178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a203ed-434a-46bc-a6cb-af6f78d0f279 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.553294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.553984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.554325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.554611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.555402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.555723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 903/1807] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:47.556848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.559441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.569100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 905/1808] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:47.570340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.589291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be858f-83c6-4eca-a850-b950d7ad5f04 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.663771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.664836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.665184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.665531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.666361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.668603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.673491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1417c8f-4230-42e7-999e-f7db0f02ede2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.683988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.688551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.688787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.689210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.689977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.692582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.709226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 904/1809] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:47.710340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.723786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272bc9a-f1c2-4b99-87a0-113cfc3410a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.730118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.731321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.731608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.732060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] PATH_INFO: `/v3/projects/1b1703711f0b4407beed61cd28cb8c73/users/225ed567f55c4b538365765fb4d8b2da/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.751224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1703711f0b4407beed61cd28cb8c73, user_id=225ed567f55c4b538365765fb4d8b2da, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.754412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.804649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 906/1810] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:47.804649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.817643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc4ce-9b02-48d2-953e-0ff5f782dbd9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.822490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.823434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.824005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.824522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] PATH_INFO: `/v3/projects/0d24228c888a436aa035fde7b43bbeeb/users/afb0dfe6ed574d6087ebaf618e0853b8/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.827123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d24228c888a436aa035fde7b43bbeeb, user_id=afb0dfe6ed574d6087ebaf618e0853b8, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.830168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 905/1811] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:47 2022] PUT /identity/v3/projects/1b1703711f0b4407beed61cd28cb8c73/users/225ed567f55c4b538365765fb4d8b2da/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:47.830315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.831003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.841473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 907/1812] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:47 2022] PUT /identity/v3/projects/0d24228c888a436aa035fde7b43bbeeb/users/afb0dfe6ed574d6087ebaf618e0853b8/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:47.844336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.900808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b06797-d0d8-41d1-ba88-d05dee14ee95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.914137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633b836-08a3-4f98-b995-bd0d2cd73591 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.918901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.919626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.919889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.920204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.920943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.923101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4275dc0-dd72-4eb2-8342-1fa4bd0551ed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.932902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 908/1813] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:47.934339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60615-fa18-4e65-a6f4-5a8fb11fff46 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.934633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60615-fa18-4e65-a6f4-5a8fb11fff46 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.934918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e60615-fa18-4e65-a6f4-5a8fb11fff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.959751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.960015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.960409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.960756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.961564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.963241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:47.965236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2e60615-fa18-4e65-a6f4-5a8fb11fff46 None None] MFA Rules not processed for user `afb0dfe6ed574d6087ebaf618e0853b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:47.966441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2e60615-fa18-4e65-a6f4-5a8fb11fff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:47.977339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 906/1814] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:47 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:47.977339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:47.982890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:47.987248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67ff39-8e91-4223-a77f-fac48f9e5ed7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:47.992091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:47.992994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:47.993283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:47.993564 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] PATH_INFO: `/v3/projects/1b1703711f0b4407beed61cd28cb8c73/users/225ed567f55c4b538365765fb4d8b2da/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:47.995672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b1703711f0b4407beed61cd28cb8c73, user_id=225ed567f55c4b538365765fb4d8b2da, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:47.998491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.011314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 907/1815] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:47 2022] PUT /identity/v3/projects/1b1703711f0b4407beed61cd28cb8c73/users/225ed567f55c4b538365765fb4d8b2da/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:48.011314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.034367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 909/1816] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:48.035673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.036222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.036497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.065127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] MFA Rules not processed for user `225ed567f55c4b538365765fb4d8b2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:48.066314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.084576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6b39-d36b-4070-ad61-bcea6926df17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.089214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.089911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.090343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.090635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.091370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.093009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.103416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 908/1817] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:48.105113 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.106039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.133974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 910/1818] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:48.135200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.147861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890f94d1-9177-4cdc-912e-d3f2ab9e0638 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.152485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.153371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.153654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.153927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] PATH_INFO: `/v3/projects/d9712855a33f4a4a9dd111455c5681eb/users/ffe1a80870f84bcd96b97be37610fe61/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.165083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa22a0-0467-4bb3-bdb8-d5987b6fc94a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.168726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.168874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9712855a33f4a4a9dd111455c5681eb, user_id=ffe1a80870f84bcd96b97be37610fe61, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.169370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.169652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.169926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.172447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d4252-d614-4def-a6f4-fc025fcf2408 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.232021 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.233497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.243727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 909/1819] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:48.244602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.245968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.259494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b171-1600-426c-9c18-4916d720655f service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.273058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 911/1820] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:48 2022] PUT /identity/v3/projects/d9712855a33f4a4a9dd111455c5681eb/users/ffe1a80870f84bcd96b97be37610fe61/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:48.274698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.274990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.275278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.304182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] MFA Rules not processed for user `ffe1a80870f84bcd96b97be37610fe61`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:48.305422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:48.329767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.330422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.330711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.330990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.379241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 912/1821] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:48.383630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.412342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.413832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.424668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 910/1822] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:48.453708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b59899-2591-4e7d-94ab-af186ab695bf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.458347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.467513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.467513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.467513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.467513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.467513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.574397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 913/1823] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:48 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:48.578496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.591148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400af6d-9268-45a5-9ea5-3994126d82c7 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.644544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.645224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.645507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.645787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.646482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.648406 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.760606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 911/1824] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:48 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:48.764761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.778461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924379d4-4837-4c3a-8122-47b64ea3d175 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.795511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.795511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.795511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.795511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.795835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.795835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:48.829436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 914/1825] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:48.831938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:48.846936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb3b4-92fb-403e-b71b-28d8f6581a3a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:48.860755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:48.861903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:48.862260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:48.862616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] PATH_INFO: `/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2/users/a9e972f8003a49afa464a28e9dd6247f/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:48.883111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1d0cbc1e0c4ee291102875b6978fb2, user_id=a9e972f8003a49afa464a28e9dd6247f, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:48.886818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:49.007498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:49.015762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:49.016253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 912/1826] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:48 2022] PUT /identity/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2/users/a9e972f8003a49afa464a28e9dd6247f/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:49.026235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fd24-545d-43da-8658-fb34639873f5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:49.085660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:49.086332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:49.086616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:49.086893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:49.087614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:49.089217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903ec57e-c860-4bad-8d99-80e59b506a49 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:49.099543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 915/1827] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:49.104413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:49.114358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5db49b-9070-4cde-8aea-1647ddf364a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:49.118852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:49.119753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:49.120156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:49.120442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] PATH_INFO: `/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2/users/a9e972f8003a49afa464a28e9dd6247f/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:49.125385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1d0cbc1e0c4ee291102875b6978fb2, user_id=a9e972f8003a49afa464a28e9dd6247f, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:49.125660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:49.136066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 913/1828] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:49 2022] PUT /identity/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2/users/a9e972f8003a49afa464a28e9dd6247f/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:49.147103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:49.147427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:49.147743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:49.175799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] MFA Rules not processed for user `a9e972f8003a49afa464a28e9dd6247f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:49.177104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:49.262986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 916/1829] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:49.448819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:49.511054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470fa54-35bd-4bf9-866b-0c031fc5ae80 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:49.516014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:49.516715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:49.516997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:49.517273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:49.591504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:49.592905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087832e-69d5-4dd6-b6eb-efd3da8a42d0 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:49.603077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 914/1830] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:50.270976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:50.357953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d9f5a-c9c8-421f-9460-e22d14602f98 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:50.362620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:50.363490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:50.363772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:50.364048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] PATH_INFO: `/v3/users/18a489ddbb54401aaf0e5cfce43f486c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:50.365261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a489ddbb54401aaf0e5cfce43f486c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:50.367167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:50.373187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:50.654915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a489ddbb54401aaf0e5cfce43f486c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:50.665225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a489ddbb54401aaf0e5cfce43f486c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:50.678274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a489ddbb54401aaf0e5cfce43f486c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:50.744167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a489ddbb54401aaf0e5cfce43f486c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:50.744995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a489ddbb54401aaf0e5cfce43f486c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:50.753854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 917/1831] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:50 2022] DELETE /identity/v3/users/18a489ddbb54401aaf0e5cfce43f486c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:50.759641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:50.760267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:50.760567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:50.782902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:50.784313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:50.851225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 915/1832] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:50.860879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:50.862255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:50.933610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3cee20-056f-4a32-b9c0-1fc930174673 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:50.938918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:50.939984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:50.940734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:50.941663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:50.956630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:50.959004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:50.979333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 918/1833] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:51.130291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:51.428274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:51.430503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:51.545822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a859a7-c760-439b-9605-0946eefc8a44 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:51.553008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:51.553745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:51.558464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:51.558464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:51.558854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:51.675066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:51.677171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:51.695828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 916/1834] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:51.874891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:51.878415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:51.912351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6419e8-0e51-4dc7-9823-3b124732bcba service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:51.916363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:51.927431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:51.928327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:51.928772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] PATH_INFO: `/v3/projects/f7f8b8169b8841b79380b8779bfd727f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:51.930675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7f8b8169b8841b79380b8779bfd727f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:51.933069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:52.072305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7f8b8169b8841b79380b8779bfd727f', 'request_id': 'req-127fb83a-aea1-4dc0-83ee-854fb5baa64d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.088638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7f8b8169b8841b79380b8779bfd727f', 'request_id': 'req-127fb83a-aea1-4dc0-83ee-854fb5baa64d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.188435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7f8b8169b8841b79380b8779bfd727f', 'request_id': 'req-127fb83a-aea1-4dc0-83ee-854fb5baa64d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.211919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] The token cache is being invalidate because project f7f8b8169b8841b79380b8779bfd727f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:52.212330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.214107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-127fb83a-aea1-4dc0-83ee-854fb5baa64d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.222172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:52.223287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 919/1835] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:51 2022] DELETE /identity/v3/projects/f7f8b8169b8841b79380b8779bfd727f => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:52.235887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bf139-e01a-452f-bb4c-2bd1aca6abdb service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:52.332413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:52.333488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:52.333869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:52.334211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] PATH_INFO: `/v3/users/225ed567f55c4b538365765fb4d8b2da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:52.335676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=225ed567f55c4b538365765fb4d8b2da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:52.338276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:52.402742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813216d7-fffa-4633-8f1d-b55586db1e65 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:52.403113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813216d7-fffa-4633-8f1d-b55586db1e65 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:52.403461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813216d7-fffa-4633-8f1d-b55586db1e65 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:52.406505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 920/1836] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:21:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 18:21:52.423657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:52.424009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:52.424392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:52.473914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:52.475200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:52.514550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:52.587306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 921/1837] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:52.613295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:52.615167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:52.626481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:52.644489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '225ed567f55c4b538365765fb4d8b2da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.652510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b075b8e0-337c-43e1-b491-9988fa2fc292 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:52.666548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '225ed567f55c4b538365765fb4d8b2da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.668815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:52.671938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:52.671938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:52.672607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:52.678969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '225ed567f55c4b538365765fb4d8b2da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.685370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:52.687670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:52.699589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 922/1838] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:52.700564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:52.702033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:52.717363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba830d-6e59-4a61-b5e6-c53d471c7e9d service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:52.722375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:52.723367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:52.723714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:52.724056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] PATH_INFO: `/v3/users/a92eaf0b35e945be89d8fc69b0971478` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:52.725466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a92eaf0b35e945be89d8fc69b0971478)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:52.727453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:52.742502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '225ed567f55c4b538365765fb4d8b2da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.743143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7fe8d02-d3c9-423d-97b2-b98401317f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '225ed567f55c4b538365765fb4d8b2da'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.750970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 917/1839] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:52 2022] DELETE /identity/v3/users/225ed567f55c4b538365765fb4d8b2da => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:52.952005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a92eaf0b35e945be89d8fc69b0971478'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.976694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a92eaf0b35e945be89d8fc69b0971478'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:52.987410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a92eaf0b35e945be89d8fc69b0971478'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.119942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a92eaf0b35e945be89d8fc69b0971478'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.120939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a92eaf0b35e945be89d8fc69b0971478'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.133379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 923/1840] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:52 2022] DELETE /identity/v3/users/a92eaf0b35e945be89d8fc69b0971478 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:53.137958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:53.138259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:53.138543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:53.159827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:53.161737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:53.241896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 918/1841] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:53.252312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:53.256662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:53.321101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da673e2a-bd3b-4ee9-9f7d-92fec0984002 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:53.326703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:53.327454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:53.328556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:53.328920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:53.340553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:53.342547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e93fc-8c86-4b72-abaa-6df2b45a22fa service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:53.361576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 924/1842] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:21:53.436204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:53.484427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:53.487195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:53.513944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7dbb6a-a39c-41c2-b481-3ff1f6b8ce63 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:53.522330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:53.523478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:53.524557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:53.525166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] PATH_INFO: `/v3/projects/1b1703711f0b4407beed61cd28cb8c73` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:53.527429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b1703711f0b4407beed61cd28cb8c73)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:53.529573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:53.673531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b1703711f0b4407beed61cd28cb8c73', 'request_id': 'req-8f432820-84be-415b-b0f9-8d27802a1d02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.680745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b1703711f0b4407beed61cd28cb8c73', 'request_id': 'req-8f432820-84be-415b-b0f9-8d27802a1d02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.830058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b1703711f0b4407beed61cd28cb8c73', 'request_id': 'req-8f432820-84be-415b-b0f9-8d27802a1d02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.842285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] The token cache is being invalidate because project 1b1703711f0b4407beed61cd28cb8c73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:53.842607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.843786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:53.847575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 919/1843] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:53 2022] DELETE /identity/v3/projects/1b1703711f0b4407beed61cd28cb8c73 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:53.853661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299a8f-8b51-42ca-835d-f621a31f6b3e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:53.853661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299a8f-8b51-42ca-835d-f621a31f6b3e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:53.853661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56299a8f-8b51-42ca-835d-f621a31f6b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:53.875625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-56299a8f-8b51-42ca-835d-f621a31f6b3e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:53.876703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-56299a8f-8b51-42ca-835d-f621a31f6b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:53.920209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:53.922535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:53.951231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 925/1844] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:53.959625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:53.960201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:53.960551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.002606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:54.004725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:54.016546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 926/1845] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:54.020358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.033137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c853a-d923-4220-ab12-4b5b31e2652a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.040391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.041422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.041622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f432820-84be-415b-b0f9-8d27802a1d02 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.042108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.042838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.043931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:54.044600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.047702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.048996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.049550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.049878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.050124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] PATH_INFO: `/v3/projects/e3809e409c554d9ba4f02b52407fba6b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.051996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3809e409c554d9ba4f02b52407fba6b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.054677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.066251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 927/1846] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:21:54.070522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.091778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acd147-4025-4d94-b7da-363e413146f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.109953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.111549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.112103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.112614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.113532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.117453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.251120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3809e409c554d9ba4f02b52407fba6b', 'request_id': 'req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.257499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3809e409c554d9ba4f02b52407fba6b', 'request_id': 'req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.290619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 928/1847] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:54 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:54.294828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.333453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3809e409c554d9ba4f02b52407fba6b', 'request_id': 'req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.346553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] The token cache is being invalidate because project e3809e409c554d9ba4f02b52407fba6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:54.347046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.347742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.349603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 920/1848] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:53 2022] DELETE /identity/v3/projects/e3809e409c554d9ba4f02b52407fba6b => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:54.354382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.356514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:54.373552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6500a58-3fb6-4586-bbb7-9af008a05fa6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.378581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.379694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.380236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.387481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.387481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.387481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.430481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2388f26-c1c3-4de6-b621-a5ce61ff8d99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.435377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.436332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.436619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.436918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] PATH_INFO: `/v3/users/afb0dfe6ed574d6087ebaf618e0853b8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.438284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=afb0dfe6ed574d6087ebaf618e0853b8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.440291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.518316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 929/1849] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:54 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:54.521710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.523311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:54.537232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d2367-78e1-47ee-b186-d52fe6b45e77 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.542247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.542918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.543288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.543552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.544318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.545902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.556723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 930/1850] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:54.560682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.571712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dcd964-33b8-4759-a9ce-300e53c0e730 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.576456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.577167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.577401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.578266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.579031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.580668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.591548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 931/1851] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:21:54.595657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.605265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9bbb8-ad50-477a-9aff-0fd576ff9e0a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.609949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.610821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.611104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.611374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] PATH_INFO: `/v3/projects/0deeba3e8599456b857d5578e99256e9/users/25e86d99071f40c7af83d553267e0b67/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.626941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0deeba3e8599456b857d5578e99256e9, user_id=25e86d99071f40c7af83d553267e0b67, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.629823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044dab5-5ad4-47ae-9e24-4fad35ac4884 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:54.685640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afb0dfe6ed574d6087ebaf618e0853b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.692304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afb0dfe6ed574d6087ebaf618e0853b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.699353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afb0dfe6ed574d6087ebaf618e0853b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.710382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 932/1852] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:54 2022] PUT /identity/v3/projects/0deeba3e8599456b857d5578e99256e9/users/25e86d99071f40c7af83d553267e0b67/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:54.720716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.721011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.721294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.746379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] MFA Rules not processed for user `25e86d99071f40c7af83d553267e0b67`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:54.747575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:54.806954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afb0dfe6ed574d6087ebaf618e0853b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.807682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afb0dfe6ed574d6087ebaf618e0853b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:54.816430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 921/1853] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:54 2022] DELETE /identity/v3/users/afb0dfe6ed574d6087ebaf618e0853b8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:54.836038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 933/1854] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:54.840521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:54.842291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:54.950370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a3cd9-6864-4e62-9674-a013c2bcc7df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:54.956051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:54.956759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:54.957088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:54.957424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:54.958183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:54.960417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.063029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 922/1855] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:54 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:55.067204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.152418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56d219-1d12-43a0-b3c4-b2bd844cc189 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.230251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.235063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.235063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.235063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.235063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.235063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.284068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.286401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.300275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb78a3-1d7d-4e34-8329-6d3aae655d2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.307967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.309040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.309556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.309933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] PATH_INFO: `/v3/projects/0d24228c888a436aa035fde7b43bbeeb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.311762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d24228c888a436aa035fde7b43bbeeb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.314573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.320585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 934/1856] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:55 2022] POST /identity/v3/users => generated 298 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:55.321778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.344989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f08ed-eb6c-434f-a117-308a8ca19497 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.351023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.351918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.352321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.352671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.353636 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.355409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.370364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 935/1857] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:55.372110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.388754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb41b1f-c195-4778-9158-c4d5faa4eee7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.388754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.388754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.389031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.389228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] PATH_INFO: `/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96/users/ef83109934d74f8689643c7f041177f1/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.404056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7cf8e7e5394d10bc387a26b07d6f96, user_id=ef83109934d74f8689643c7f041177f1, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.407457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.485782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:55.514565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 936/1858] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:55 2022] PUT /identity/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96/users/ef83109934d74f8689643c7f041177f1/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:55.518725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.524782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d24228c888a436aa035fde7b43bbeeb', 'request_id': 'req-7c274b2c-0078-4e6f-a719-db128e25e943'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.532328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d24228c888a436aa035fde7b43bbeeb', 'request_id': 'req-7c274b2c-0078-4e6f-a719-db128e25e943'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.584533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b74df-f05f-44c6-8fc4-bb56370edd9e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.610812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d24228c888a436aa035fde7b43bbeeb', 'request_id': 'req-7c274b2c-0078-4e6f-a719-db128e25e943'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.622535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] The token cache is being invalidate because project 0d24228c888a436aa035fde7b43bbeeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:55.622846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.623498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.625280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 923/1859] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:55 2022] DELETE /identity/v3/projects/0d24228c888a436aa035fde7b43bbeeb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:55.625935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.627315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.654960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.672584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.672908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.673199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.674127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.675793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18e39c9-f2d8-4890-9c77-92da1002bd5a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.687680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 937/1860] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:55.689234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.689907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.689907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.709759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:55.711166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.721687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 938/1861] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:55.722556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.722722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c274b2c-0078-4e6f-a719-db128e25e943 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.724296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.728762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.730524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.730817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.731370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] PATH_INFO: `/v3/users/cdf3fb2a409b43faba4a3c640e2271e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.732788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf3fb2a409b43faba4a3c640e2271e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.735331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.741744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbfea7-06c7-424a-8fe3-2d1e2ed6f6a5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.748257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.749584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.750243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.750668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] PATH_INFO: `/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96/users/ef83109934d74f8689643c7f041177f1/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.752823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7cf8e7e5394d10bc387a26b07d6f96, user_id=ef83109934d74f8689643c7f041177f1, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:55.755677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d312b4a4-50e1-4448-aa07-e345c37cd54f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:55.772163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 939/1862] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:55 2022] PUT /identity/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96/users/ef83109934d74f8689643c7f041177f1/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:55.772163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38c81-d5f7-46c9-92c2-b36b587cecbc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.772163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38c81-d5f7-46c9-92c2-b36b587cecbc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.772163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c38c81-d5f7-46c9-92c2-b36b587cecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.807637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-66c38c81-d5f7-46c9-92c2-b36b587cecbc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:55.809661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66c38c81-d5f7-46c9-92c2-b36b587cecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.876665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 940/1863] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:55.877818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.878111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.878396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.910111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] MFA Rules not processed for user `ef83109934d74f8689643c7f041177f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:55.911842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:55.928441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf3fb2a409b43faba4a3c640e2271e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.940863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf3fb2a409b43faba4a3c640e2271e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.947959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf3fb2a409b43faba4a3c640e2271e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:55.980543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 941/1864] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:55.981544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:55.991503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f297d0-954f-4b5b-9af6-ee50b4db2dc6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:55.996443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:55.997101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:55.997388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:55.997698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:55.998433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:55.998789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.000924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.012732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 942/1865] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:21:56.013702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.017627 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.029495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf3fb2a409b43faba4a3c640e2271e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.030128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf3fb2a409b43faba4a3c640e2271e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.036990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 924/1866] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:55 2022] DELETE /identity/v3/users/cdf3fb2a409b43faba4a3c640e2271e8 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:56.037810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.039112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.078379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d83d10-8779-4a4c-ada0-a0f54077b1c4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.118183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8c251-c784-4074-a6db-aa97d251bf2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.123641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.124808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.125131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.125416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.126119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.128045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.131915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.132654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.132945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.133216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.135571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.198530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.199925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda56fc1-3157-4370-a81f-77781d0c9762 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.210214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 943/1867] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:56.211518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.211805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.212087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.231505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:56.231868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.232576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 925/1868] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:56 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:56.233519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.244300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:56.307555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f02c15c-de63-4cb9-a308-549eaaca4107 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.315355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 944/1869] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:56.315355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.315355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.316511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.317384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.317726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.318096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.318920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.321415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.328335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c38099-db4e-47d7-8da6-ea9a23e80f26 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.333679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.334614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.334905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.336050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] PATH_INFO: `/v3/users/ffe1a80870f84bcd96b97be37610fe61` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.336460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffe1a80870f84bcd96b97be37610fe61)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.338550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.489915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 926/1870] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:56 2022] POST /identity/v3/users => generated 283 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:56.492239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.495013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.561505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fbdc55-e3a5-4d1c-8d84-498a09880b4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.571970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.572863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.573291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.574352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.585362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffe1a80870f84bcd96b97be37610fe61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.588829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.590778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.601209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 927/1871] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:56.602049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.603371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.611376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffe1a80870f84bcd96b97be37610fe61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.626800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffe1a80870f84bcd96b97be37610fe61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.688594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abbb1f-f1c5-4ddb-8669-99a3592e5295 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.694896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.695301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.695590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.696202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.698592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.739156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffe1a80870f84bcd96b97be37610fe61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.740428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffe1a80870f84bcd96b97be37610fe61'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:56.747648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 945/1872] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:56 2022] DELETE /identity/v3/users/ffe1a80870f84bcd96b97be37610fe61 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:56.748579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.752494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.772215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.774238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8de8-58a1-42d2-a457-b2a39298a502 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.799802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 928/1873] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:56.804744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.804744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.806196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.844023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:56.845407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:56.881297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a888b8c-3407-47f4-84a9-c185cbb6174a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.886868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.887706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.888000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.888408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.889176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.891029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.905033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 946/1874] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:56.906779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.920909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb99fb9-5fb7-498b-bebe-d8c798206251 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.929581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:56.930349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:56.930644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:56.930916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:56.931658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:56.933509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:56.960867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 947/1875] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:56.963831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.978172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 929/1876] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:56.992974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed41bea-e2cd-4b46-bf47-c37aa27b7963 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:56.996842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:56.998606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.012267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.013186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.014987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.014987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] PATH_INFO: `/v3/projects/40b6c4bf42634ae9b0e56a8d3eb0314c/users/265261f6b0b14ee7b5400615a93e032a/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.052048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40b6c4bf42634ae9b0e56a8d3eb0314c, user_id=265261f6b0b14ee7b5400615a93e032a, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.055955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.123904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca249e-dee9-4dcb-aad4-0fa44afeb655 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.136382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.136382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.136688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.136921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.156435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.157887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a3e9e7-0cc2-4d3f-82ac-df9e2c47b486 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.175687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 930/1877] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:57.198716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 948/1878] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:56 2022] PUT /identity/v3/projects/40b6c4bf42634ae9b0e56a8d3eb0314c/users/265261f6b0b14ee7b5400615a93e032a/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:57.209182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.209473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.209750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.213661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:57.238029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:57.240054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.270262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] MFA Rules not processed for user `265261f6b0b14ee7b5400615a93e032a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:57.272161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.346776 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564d53d-8454-4ae1-a677-bd58f9c27872 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.352271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.352818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.353243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.353498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] PATH_INFO: `/v3/projects/543421201e684cffb984420db266ac70` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.354841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=543421201e684cffb984420db266ac70)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.356867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.371750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 931/1879] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:57.376749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:57.390242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bb5b9-8cec-406d-8935-b99cbc346b10 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.396190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.396866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.397138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.397551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.398282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.400427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.500930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '543421201e684cffb984420db266ac70', 'request_id': 'req-73ccfdde-b808-43cf-93bd-a0b2fe20e772'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.507377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '543421201e684cffb984420db266ac70', 'request_id': 'req-73ccfdde-b808-43cf-93bd-a0b2fe20e772'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.524160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 932/1880] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:57 2022] POST /identity/v3/projects => generated 369 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:57.524160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:57.529266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.596757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae41bd-d02b-463d-818f-81129c01f5cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.599889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '543421201e684cffb984420db266ac70', 'request_id': 'req-73ccfdde-b808-43cf-93bd-a0b2fe20e772'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.614596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] The token cache is being invalidate because project 543421201e684cffb984420db266ac70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:57.614886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.615318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.616309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.616579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.616852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] PATH_INFO: `/v3/users/25e86d99071f40c7af83d553267e0b67` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.617726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.618978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=25e86d99071f40c7af83d553267e0b67)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.621389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 949/1881] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:57 2022] DELETE /identity/v3/projects/543421201e684cffb984420db266ac70 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:57.624310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.624415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:57.627132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.740007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ccfdde-b808-43cf-93bd-a0b2fe20e772 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.749787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.750626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.750948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.751235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.753111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.754370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.857739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 950/1882] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:21:57 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:21:57.858680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:57.860337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:57.866841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e86d99071f40c7af83d553267e0b67'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.872574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bae64-a0f2-4ed3-a1a9-92de3692f16a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:57.877689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:57.878624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:57.878914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:57.884454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] PATH_INFO: `/v3/users/3838e648293b4b51a9fbbf99e3959765` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:57.884577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e86d99071f40c7af83d553267e0b67'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.884658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3838e648293b4b51a9fbbf99e3959765)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:57.884658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:57.888332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e86d99071f40c7af83d553267e0b67'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.989983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e86d99071f40c7af83d553267e0b67'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.991087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e86d99071f40c7af83d553267e0b67'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:57.999719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 933/1883] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:57 2022] DELETE /identity/v3/users/25e86d99071f40c7af83d553267e0b67 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.000591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.001881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.067555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069af5d-80e5-4dab-a41e-4f0950f1ef8c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.072443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.073373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.073683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.073997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] PATH_INFO: `/v3/projects/d9712855a33f4a4a9dd111455c5681eb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.075222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9712855a33f4a4a9dd111455c5681eb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.077990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.132722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3838e648293b4b51a9fbbf99e3959765'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.145007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3838e648293b4b51a9fbbf99e3959765'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.151635 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3838e648293b4b51a9fbbf99e3959765'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.216248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9712855a33f4a4a9dd111455c5681eb', 'request_id': 'req-abf8a439-fe1a-496a-a2b6-16fa5c506542'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.223526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9712855a33f4a4a9dd111455c5681eb', 'request_id': 'req-abf8a439-fe1a-496a-a2b6-16fa5c506542'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.252649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3838e648293b4b51a9fbbf99e3959765'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.253991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3838e648293b4b51a9fbbf99e3959765'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.262243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 951/1884] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:57 2022] DELETE /identity/v3/users/3838e648293b4b51a9fbbf99e3959765 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.263264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.264715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.321331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9712855a33f4a4a9dd111455c5681eb', 'request_id': 'req-abf8a439-fe1a-496a-a2b6-16fa5c506542'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.334172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] The token cache is being invalidate because project d9712855a33f4a4a9dd111455c5681eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:58.335022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.336001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abf8a439-fe1a-496a-a2b6-16fa5c506542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.347835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822558a7-efb0-4b17-8f39-a69e407d560c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.347835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.347835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.347835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.348167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.348167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.349005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 934/1885] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:57 2022] DELETE /identity/v3/projects/d9712855a33f4a4a9dd111455c5681eb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.349107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.351259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.351766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.352481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.361240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 952/1886] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:58.362118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.363872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.371990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:58.373284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.379345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f61651-0e74-45a0-aa4d-015bdf319ff1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.381861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 935/1887] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:58.382636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.383953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.386563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.387454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.387752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.388027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] PATH_INFO: `/v3/users/a9e972f8003a49afa464a28e9dd6247f` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.389287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e972f8003a49afa464a28e9dd6247f)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.391922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.401975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bd9f3-43d1-4ef1-b3c3-3bc841132b83 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.406620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.407502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.407784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.408060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] PATH_INFO: `/v3/projects/f163137e1c294addb7770264901b17e2/users/12b3756a1e78447c9bf2788ce176d113/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.422945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f163137e1c294addb7770264901b17e2, user_id=12b3756a1e78447c9bf2788ce176d113, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.425615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.498001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 936/1888] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:58 2022] PUT /identity/v3/projects/f163137e1c294addb7770264901b17e2/users/12b3756a1e78447c9bf2788ce176d113/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.501982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.503612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.591640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e972f8003a49afa464a28e9dd6247f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.598987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc28d9-3d0d-418a-bfe7-9c607568bc1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.608408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.609708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.609993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.610267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.620242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e972f8003a49afa464a28e9dd6247f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.641035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e972f8003a49afa464a28e9dd6247f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.692679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.694137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.704772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 937/1889] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:58.705672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.715434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e972f8003a49afa464a28e9dd6247f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.715577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28016274-a5e9-4c62-b57a-103abb977f1c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.716300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e972f8003a49afa464a28e9dd6247f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:58.727332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 953/1890] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:21:58 2022] DELETE /identity/v3/users/a9e972f8003a49afa464a28e9dd6247f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.731276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.731970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.732284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.732567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.733307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.735486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.761395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 938/1891] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:21:58.762986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.764558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.876530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079bb951-07dd-4f6f-9f26-97c080bb8201 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.881611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:58.887186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:58.888294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:58.891546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.891660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:58.891754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.891754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] PATH_INFO: `/v3/projects/f163137e1c294addb7770264901b17e2/users/12b3756a1e78447c9bf2788ce176d113/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.896144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f163137e1c294addb7770264901b17e2, user_id=12b3756a1e78447c9bf2788ce176d113, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:58.899316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bdfd4-2e7c-42f8-9589-72bb5b907f9e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:58.916712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7f106-d6ba-44e7-ad7d-c554d356968a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:58.936252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 954/1892] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:21:58 2022] PUT /identity/v3/projects/f163137e1c294addb7770264901b17e2/users/12b3756a1e78447c9bf2788ce176d113/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:58.944069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:58.944490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:58.944773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:58.996717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] MFA Rules not processed for user `12b3756a1e78447c9bf2788ce176d113`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:58.998886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.024482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.034074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.034074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.034074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] PATH_INFO: `/v3/projects/2f43ef3ceec043e1b8724eef76253fcd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.034074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f43ef3ceec043e1b8724eef76253fcd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.035221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.155205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 955/1893] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:59.170933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.173552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.201693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f43ef3ceec043e1b8724eef76253fcd', 'request_id': 'req-89724dc1-47a8-4588-bab5-942412130c60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.210302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f43ef3ceec043e1b8724eef76253fcd', 'request_id': 'req-89724dc1-47a8-4588-bab5-942412130c60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.264863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c38a41-8d2b-4810-b7cd-6df05d70d741 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.292946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f43ef3ceec043e1b8724eef76253fcd', 'request_id': 'req-89724dc1-47a8-4588-bab5-942412130c60'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.311379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] The token cache is being invalidate because project 2f43ef3ceec043e1b8724eef76253fcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:59.312319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.313100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89724dc1-47a8-4588-bab5-942412130c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.315065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 939/1894] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:58 2022] DELETE /identity/v3/projects/2f43ef3ceec043e1b8724eef76253fcd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:21:59.320045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.320368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.327184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.340893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.341721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.342165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.342564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.343984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:59.344756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.345775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.443324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.444821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe5a3db-4763-403c-8914-95cc39094439 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.455563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 956/1895] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:21:59.457266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 940/1896] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:21:59.464770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.465808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.465808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.486383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:21:59.491454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.502499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 957/1897] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:21:59.507071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.517282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b2891-d550-4351-bf73-3069b5ce5c47 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.522098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.522764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.523101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.523384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.524145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:21:59.524450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.526139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.543788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 941/1898] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:21:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:21:59.543953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.554249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b0ce8-bfb2-4a10-81d1-fced9f23ddf6 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.567051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.568182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.569160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.569614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.569834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.572550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.573557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.573661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.591632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9af446-e51b-4153-bfbe-5736bd528e2f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.601968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.601968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.601968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.601968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] PATH_INFO: `/v3/projects/0deeba3e8599456b857d5578e99256e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.602334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0deeba3e8599456b857d5578e99256e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.603862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.682536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 958/1899] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:21:59 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:21:59.683460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.685604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.742134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0deeba3e8599456b857d5578e99256e9', 'request_id': 'req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.749448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0deeba3e8599456b857d5578e99256e9', 'request_id': 'req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.756606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf28bc3b-b70b-4dd1-975a-bbfc8c8ccc98 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.821144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.822148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.822437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.822717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] PATH_INFO: `/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.823930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1d0cbc1e0c4ee291102875b6978fb2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:21:59.826022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:21:59.869312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0deeba3e8599456b857d5578e99256e9', 'request_id': 'req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.880008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] The token cache is being invalidate because project 0deeba3e8599456b857d5578e99256e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:21:59.880326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.880966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.882538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 942/1900] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:59 2022] DELETE /identity/v3/projects/0deeba3e8599456b857d5578e99256e9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:21:59.883300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:21:59.884630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.892674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:21:59.943992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7e72f-9dc3-4ecf-a36e-de32e23f2fa5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:21:59.947604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:21:59.948370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:21:59.956551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:21:59.956879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:21:59.965515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:21:59.968736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1d0cbc1e0c4ee291102875b6978fb2', 'request_id': 'req-7ca08518-6ae1-48cf-9cac-57c62adbef92'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:21:59.976184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1d0cbc1e0c4ee291102875b6978fb2', 'request_id': 'req-7ca08518-6ae1-48cf-9cac-57c62adbef92'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.018542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.020044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.028866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 943/1901] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:00.029633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.031446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.033218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1d0cbc1e0c4ee291102875b6978fb2', 'request_id': 'req-7ca08518-6ae1-48cf-9cac-57c62adbef92'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.045365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] The token cache is being invalidate because project 6b1d0cbc1e0c4ee291102875b6978fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:00.045696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.045931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e166bfd-6c39-425c-aa6a-58a583383775 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.046947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.052399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 959/1902] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:21:59 2022] DELETE /identity/v3/projects/6b1d0cbc1e0c4ee291102875b6978fb2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:00.052399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.052399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.109563 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.110231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.110514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.110790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.111480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.113456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec8d16-f223-4040-b168-4ba485425054 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.126976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca08518-6ae1-48cf-9cac-57c62adbef92 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.132030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.132944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.133233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.133542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] PATH_INFO: `/v3/users/ef83109934d74f8689643c7f041177f1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.134751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef83109934d74f8689643c7f041177f1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.136784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.220319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 944/1903] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/users => generated 294 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:00.220319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.220319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.220319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.237859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:00.239205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.247476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 945/1904] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:00.248289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.249552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.261096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03b0939-e9e4-4de1-804b-bdb1208e8574 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.267071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.267884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.268191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.268466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.269254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.271135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ffa16-f89c-44b3-a496-9a436eaa7ac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.284809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 946/1905] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:00.284809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b550-8cc0-4630-a637-a415271362bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.284809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b550-8cc0-4630-a637-a415271362bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.284809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340b550-8cc0-4630-a637-a415271362bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.302278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0340b550-8cc0-4630-a637-a415271362bd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:00.303551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0340b550-8cc0-4630-a637-a415271362bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.311677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 947/1906] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:00.312598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340b550-8cc0-4630-a637-a415271362bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.322623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0340b550-8cc0-4630-a637-a415271362bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.328867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.329538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.329820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.330096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.330825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.332556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.343861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 948/1907] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:00.344149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.353715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ccb6a-2402-4ffd-bbe3-bd5a44611dbc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.358462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.359151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.359389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.359672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.360434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:00.360768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.362349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.369039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef83109934d74f8689643c7f041177f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.374496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 949/1908] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:00.375413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.384447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef83109934d74f8689643c7f041177f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.384977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16a18f-f848-4135-8c42-1169ef70dbb9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.389666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.391060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.391348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.391625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] PATH_INFO: `/v3/projects/73c41a88181a45c983cfba67a9790f5b/users/f61c69d696124899afb976e1e71e0665/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.391853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef83109934d74f8689643c7f041177f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.407649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c41a88181a45c983cfba67a9790f5b, user_id=f61c69d696124899afb976e1e71e0665, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.410795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bba9ef-d01c-4e6d-b11e-870d4929d7d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.481173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef83109934d74f8689643c7f041177f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.481901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef83109934d74f8689643c7f041177f1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:00.488214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 960/1909] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:00 2022] DELETE /identity/v3/users/ef83109934d74f8689643c7f041177f1 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:00.488979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.490300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.519618 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 950/1910] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:00 2022] PUT /identity/v3/projects/73c41a88181a45c983cfba67a9790f5b/users/f61c69d696124899afb976e1e71e0665/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:00.538972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.539705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.540043 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.569781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] MFA Rules not processed for user `f61c69d696124899afb976e1e71e0665`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:00.570905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.577226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee777f54-39b1-4f85-bfbd-4f3b1b9d8e74 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.640654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.641344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.651324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.651324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.651324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.651324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:00.651668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 951/1911] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:00.651668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:00.651668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:00.667300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff531b3a-4f02-48b1-852e-f8a557ecd797 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:00.672340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:00.673022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:00.673308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:00.673585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:00.674295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:00.676275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.064275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 952/1912] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/projects => generated 387 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:01.070592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 961/1913] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:00 2022] POST /identity/v3/projects => generated 379 bytes in 579 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:01.070786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.071653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.150077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da628e-9878-4083-a11b-e1f88cb3b500 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.154979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.155126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0267-c3d0-4a24-a6ca-b8c54e59af9c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.155718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.156062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.156373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.157101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.159043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.160549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.161653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.165772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.165772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.165772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.165772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.249326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 953/1914] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:01.252864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 962/1915] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:01.252993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.253373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.254415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.265375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d264cb-192d-48e5-aafc-dbe495ce9e6b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.270717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121ff51-dde0-4345-bca7-4885dc9ecbf9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.271926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.272768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.273061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.273420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.274085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.276006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.276228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.281041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.281041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.281041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] PATH_INFO: `/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.281041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7cf8e7e5394d10bc387a26b07d6f96)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.282657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.289278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 963/1916] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:01.290492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.303052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe6bf0-b05e-40f9-b61f-5c7aad1cd5f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.308516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.309932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.309932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.310120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.310801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.313364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.325434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 964/1917] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:01.327000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.336292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c03859-9d9d-472c-94c5-17e2cfd6924e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.340869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.341733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.342021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.342332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] PATH_INFO: `/v3/projects/4c40fabee4a24675a79720970a12c57b/users/587fc91776cc4499a77d85442ec3fd0e/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.357634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c40fabee4a24675a79720970a12c57b, user_id=587fc91776cc4499a77d85442ec3fd0e, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.360952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.444823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 965/1918] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:01 2022] PUT /identity/v3/projects/4c40fabee4a24675a79720970a12c57b/users/587fc91776cc4499a77d85442ec3fd0e/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:01.447438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.455675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7cf8e7e5394d10bc387a26b07d6f96', 'request_id': 'req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:01.462557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7cf8e7e5394d10bc387a26b07d6f96', 'request_id': 'req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:01.510222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828ff14-c9dd-4bfa-934a-e99712cc0abc admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.565381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.566113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.566392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.566672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.567394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.569023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.572486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7cf8e7e5394d10bc387a26b07d6f96', 'request_id': 'req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:01.579447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 966/1919] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:01.580320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.584524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] The token cache is being invalidate because project 4f7cf8e7e5394d10bc387a26b07d6f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:01.584817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:01.585484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:01.587081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 954/1920] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:01 2022] DELETE /identity/v3/projects/4f7cf8e7e5394d10bc387a26b07d6f96 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:01.587882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.589209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.590247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b41b2-8157-4773-bb8d-1af6a303fb5c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.595493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.596898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.597186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.597461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.598315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.599782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48837b7-2ea7-464b-825f-d48bb5e36a05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.602634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa95bac4-e23d-4c8f-b9e1-945c7ad4d74e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.607356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.608925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.609214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.609495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] PATH_INFO: `/v3/projects/011c11b507184d7aa8bd03360f67c929/users/1110701263114125ac448ef55dd6753d/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.610345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 967/1921] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:01.611686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.611984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.612289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.624890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=011c11b507184d7aa8bd03360f67c929, user_id=1110701263114125ac448ef55dd6753d, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.627597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509143b8-9f0f-4e9f-9bea-5c418f0b95a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.630515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:01.631821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.640504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 968/1922] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:01.641426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.642649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.654065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e8672-6853-48aa-a4e0-a0fc2e87f076 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.659292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.660196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.660489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.660766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] PATH_INFO: `/v3/projects/4c40fabee4a24675a79720970a12c57b/users/587fc91776cc4499a77d85442ec3fd0e/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.663027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c40fabee4a24675a79720970a12c57b, user_id=587fc91776cc4499a77d85442ec3fd0e, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.665677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53baef88-bf3a-44bd-a5d0-bf9968dd7431 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.675678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 969/1923] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:01 2022] PUT /identity/v3/projects/4c40fabee4a24675a79720970a12c57b/users/587fc91776cc4499a77d85442ec3fd0e/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:01.681580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d39c-c83e-4426-8633-d742ef560182 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.681580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d39c-c83e-4426-8633-d742ef560182 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.681580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0d39c-c83e-4426-8633-d742ef560182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.695850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-51b0d39c-c83e-4426-8633-d742ef560182 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:01.697041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-51b0d39c-c83e-4426-8633-d742ef560182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.698881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:01.733621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 955/1924] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:01 2022] PUT /identity/v3/projects/011c11b507184d7aa8bd03360f67c929/users/1110701263114125ac448ef55dd6753d/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:01.742449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.742449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.742449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.779321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:01.785517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 970/1925] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:01.785517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.785517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.785517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.789428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] MFA Rules not processed for user `587fc91776cc4499a77d85442ec3fd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:01.790654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.819960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] MFA Rules not processed for user `1110701263114125ac448ef55dd6753d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:01.821226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.883847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 956/1926] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:01.885009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.897803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 971/1927] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:01.898766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.900030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:01.951527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53825d67-18e1-4d1d-9521-0e595fab3e7f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.957072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.957799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.958092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.958374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.959114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:01.959449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.960929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97ca54-e6d0-409d-a74d-2256468d56c7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.961089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.975993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 957/1928] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:01.977072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:01.977893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.978874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.978994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.979243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.987450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2629aff7-89d7-4a81-98ba-d2a453373167 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:01.989438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.990890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:01.993807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:01.996420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:01.996420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:01.996420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:01.996420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:01.997636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.001181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 972/1929] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:02.002007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.012501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cc716-9ecb-4270-a71a-f2da706d48cd service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.019561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.020386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.025151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.025151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.025151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.029710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.116285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 958/1930] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:01 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:02.120187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.142466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 973/1931] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:02 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:02.145949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.210175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d72e8-b715-43af-acda-3b034f1a3e6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.219206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac024e-6f86-4579-99f3-3cf8ee17056e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.225661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.227036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.227322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.227597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] PATH_INFO: `/v3/users/f61c69d696124899afb976e1e71e0665` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.228874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61c69d696124899afb976e1e71e0665)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.230952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.257336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.258364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.259459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.259772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.260527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.267031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.367774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 974/1932] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:02 2022] POST /identity/v3/users => generated 298 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:02.368622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.379186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9e3b7-51c6-4541-a505-ea17c1923ebf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.384444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.385059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.385384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.385748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.386371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.389488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.465076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61c69d696124899afb976e1e71e0665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:02.476994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61c69d696124899afb976e1e71e0665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:02.484227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61c69d696124899afb976e1e71e0665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:02.515566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 975/1933] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:02 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:02.516566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.529042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147b6c93-4015-4a65-8285-b641b7a3cb0c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.533953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.534640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.534915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.535192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.536215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.537836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.550702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 976/1934] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:02.551704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.563922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fb00b-a541-41f2-9520-bd82ffae50bf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.580073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.581339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.581699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.586983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.586983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.586983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.596081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61c69d696124899afb976e1e71e0665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:02.596742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61c69d696124899afb976e1e71e0665'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:02.601059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 977/1935] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:02.605126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.606569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 959/1936] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:02 2022] DELETE /identity/v3/users/f61c69d696124899afb976e1e71e0665 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:02.607643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.611425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:02.612041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:02.628742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5202b-d60d-479d-baa9-45fd31c2f573 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.704683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158f08e-c2fc-4fce-9c53-cbc79727ce54 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.710640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.711609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.712144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.712652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.713903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.728198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.728198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.728198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.728198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] PATH_INFO: `/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f/users/6d4cc7774e3e41f6b7d968f1367e076a/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.730196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6240034-5e5b-43d1-b05b-235856e50b4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.743281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 960/1937] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:02.745207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.745828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.747082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.763812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12f7817ad574118af1ffb0dd18b3f2f, user_id=6d4cc7774e3e41f6b7d968f1367e076a, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.767314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.777187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:02.778565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:02.790839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 961/1938] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:02.790839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.801434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2d08a-681e-4769-b505-385f91cb2ac5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:02.807176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:02.810560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:02.810560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:02.810560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] PATH_INFO: `/v3/projects/162902362436474a9264523bbc8d8481/users/c96eb8ad9e614a489b31f19fd9f03022/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:02.838685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162902362436474a9264523bbc8d8481, user_id=c96eb8ad9e614a489b31f19fd9f03022, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:02.841788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:02.893128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 978/1939] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:02 2022] PUT /identity/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f/users/6d4cc7774e3e41f6b7d968f1367e076a/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:02.897034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:02.901704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:02.992281 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 962/1940] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:02 2022] PUT /identity/v3/projects/162902362436474a9264523bbc8d8481/users/c96eb8ad9e614a489b31f19fd9f03022/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:02.999742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.016681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a84832d-db9f-4fb2-a0e7-123b2563bb0f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.086823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.088080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.088080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.088080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.101167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.103374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e046c33-b380-41a5-8617-86414e1f45a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.103491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27314e1a-8e6c-4271-a490-8aee70154fad service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.113528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.114634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.115130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.115580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.116583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.117976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 979/1941] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:03.118657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.120248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.120569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.120817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.137996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 963/1942] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:03.139278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.154635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ded645-a480-4d13-bd07-93aad1a6e561 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.160764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.164418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:03.165137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.165634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.166398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] PATH_INFO: `/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f/users/6d4cc7774e3e41f6b7d968f1367e076a/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.167377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] MFA Rules not processed for user `c96eb8ad9e614a489b31f19fd9f03022`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:03.168918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:03.171689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12f7817ad574118af1ffb0dd18b3f2f, user_id=6d4cc7774e3e41f6b7d968f1367e076a, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.174230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0eca2b-ca43-4c79-8fac-dba02854bfd7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.195510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 964/1943] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:03 2022] PUT /identity/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f/users/6d4cc7774e3e41f6b7d968f1367e076a/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:03.212842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.213677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.214323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.253316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] MFA Rules not processed for user `6d4cc7774e3e41f6b7d968f1367e076a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:03.254450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:03.282496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 980/1944] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:03.287006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.304661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4abab5-3d98-471a-8ea5-12e71f47a27a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.342395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 965/1945] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:03.379279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.380078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.380405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.390366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.390366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.390366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.494285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.496172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:03.528444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 981/1946] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:03 2022] POST /identity/v3/projects => generated 375 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:03.532409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.577695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1bc08-1851-436d-9d3b-dc26ee3e0a30 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.632649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.633468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.633653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.633942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.707648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.717039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.745984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa03bf-5987-43bc-aec7-ce92faaa9b70 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.746285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 966/1947] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:03.759609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.760671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.761061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.761395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.762432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.765588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.791372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:03.858001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.867842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438ff51-1514-4756-959b-5ba91729e524 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.872045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.873331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.873331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.873331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.876023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:03.912746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 982/1948] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:03 2022] POST /identity/v3/users => generated 294 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:03.916342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.927654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd454bb8-391e-4cdf-b2b7-d0bcc1bc31a7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.933684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.934491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.935467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.935961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.937074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:03.939738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.939738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.956991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 983/1949] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:03.958087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:03.971079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fae30-9291-450e-b666-6f3e3fc1a589 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:03.976402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:03.977356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:03.977768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:03.978428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] PATH_INFO: `/v3/projects/6ef13c400da34b57ab0f092433f59578/users/be05440d104e4b5a9d15d247036a10eb/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:03.981637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:03.983103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:03.996940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 967/1950] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:04.004214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef13c400da34b57ab0f092433f59578, user_id=be05440d104e4b5a9d15d247036a10eb, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.004214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.087413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 984/1951] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:03 2022] PUT /identity/v3/projects/6ef13c400da34b57ab0f092433f59578/users/be05440d104e4b5a9d15d247036a10eb/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:04.091804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:04.109117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f75cfd-088b-4280-98ad-64deea3f0682 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:04.189745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:04.190601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.190792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.191079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.191823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.193472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.204459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 968/1952] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:04.208453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:04.228927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:04.230993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:04.233333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e7337-c3cc-44e9-bb8b-e3e300477968 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:04.248535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca128bb-4fc8-4a32-9ebe-ed134525643e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:04.249476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:04.250497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.251436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.251806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] PATH_INFO: `/v3/projects/6ef13c400da34b57ab0f092433f59578/users/be05440d104e4b5a9d15d247036a10eb/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.254886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef13c400da34b57ab0f092433f59578, user_id=be05440d104e4b5a9d15d247036a10eb, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.259950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74a72-1d8a-4c59-a200-a36301fae719 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.263665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:04.264763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.265152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.265527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] PATH_INFO: `/v3/projects/73c41a88181a45c983cfba67a9790f5b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.267524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c41a88181a45c983cfba67a9790f5b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.270399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.286925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 985/1953] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:04 2022] PUT /identity/v3/projects/6ef13c400da34b57ab0f092433f59578/users/be05440d104e4b5a9d15d247036a10eb/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:04.298719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.299129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.299504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.332579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] MFA Rules not processed for user `be05440d104e4b5a9d15d247036a10eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:04.334093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:04.429296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 986/1954] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:04.442116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:04.443602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:04.494567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c41a88181a45c983cfba67a9790f5b', 'request_id': 'req-d697c6bc-cabf-4305-a76b-00c4684946fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:04.504261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c41a88181a45c983cfba67a9790f5b', 'request_id': 'req-d697c6bc-cabf-4305-a76b-00c4684946fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:04.528455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925475f-8919-4189-9ccc-adccacaa1b2d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:04.579448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c41a88181a45c983cfba67a9790f5b', 'request_id': 'req-d697c6bc-cabf-4305-a76b-00c4684946fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:04.597301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] The token cache is being invalidate because project 73c41a88181a45c983cfba67a9790f5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:04.597927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:04.599026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:04.606005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 969/1955] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:04 2022] DELETE /identity/v3/projects/73c41a88181a45c983cfba67a9790f5b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:04.607411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:04.610322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:04.647044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:04.647896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.648091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.648426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.653158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:04.741727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697c6bc-cabf-4305-a76b-00c4684946fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:04.761516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:04.762433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:04.762575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:04.762844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] PATH_INFO: `/v3/users/587fc91776cc4499a77d85442ec3fd0e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:04.769620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=587fc91776cc4499a77d85442ec3fd0e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.770936 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.787526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:04.789361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:04.819691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 987/1956] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:05.042725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587fc91776cc4499a77d85442ec3fd0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:05.061160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587fc91776cc4499a77d85442ec3fd0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:05.070201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587fc91776cc4499a77d85442ec3fd0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:05.157543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587fc91776cc4499a77d85442ec3fd0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:05.158388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54bbc072-74c4-418e-b034-0b990313f88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587fc91776cc4499a77d85442ec3fd0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:05.167128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 970/1957] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:04 2022] DELETE /identity/v3/users/587fc91776cc4499a77d85442ec3fd0e => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:05.382339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:06.039713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:06.283109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:06.527270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:06.552442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef81c4-18be-4dab-a62a-90e3247664e2 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:06.635436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:06.636518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:06.636806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:06.637170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] PATH_INFO: `/v3/projects/4c40fabee4a24675a79720970a12c57b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:06.638622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c40fabee4a24675a79720970a12c57b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:06.640720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:06.779881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c40fabee4a24675a79720970a12c57b', 'request_id': 'req-18998c5f-81a1-4449-8999-d63636960e4c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:06.788330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c40fabee4a24675a79720970a12c57b', 'request_id': 'req-18998c5f-81a1-4449-8999-d63636960e4c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:06.889258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c40fabee4a24675a79720970a12c57b', 'request_id': 'req-18998c5f-81a1-4449-8999-d63636960e4c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:06.914285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] The token cache is being invalidate because project 4c40fabee4a24675a79720970a12c57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:06.914666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:06.917611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-18998c5f-81a1-4449-8999-d63636960e4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:06.920986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 988/1958] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:06 2022] DELETE /identity/v3/projects/4c40fabee4a24675a79720970a12c57b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:06.926458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:06.928031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:06.928031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:06.958266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:06.962135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:07.056647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 971/1959] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:07.069462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.069993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.070252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.093398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:07.093398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:07.104333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 989/1960] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:07.106611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.118652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910d337-5b6e-47e1-b734-a87c2dfbe067 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.130171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.130171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.130171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.130171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.130496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:07.130496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.130496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.162241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 972/1961] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:07.163652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.174255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166f683-faf8-4f78-b406-4885c2d3bf0d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.179555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.180267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.180552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.180830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.181545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.183817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.295316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 990/1962] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/projects => generated 389 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:07.299399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.312836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f588b09-795a-4c88-bbc4-4419f265037f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.379103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.379779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.380266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.380518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.381230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.383241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.512636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 973/1963] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:07.513791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.524524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98987dd-6832-49ee-b1ad-015511985332 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.529077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.529845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.530279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.530597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.531356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.533168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.544610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 991/1964] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:07.548854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.558890 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a9d54d-4369-4fad-90ff-3f065e892222 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.564376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.565031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.565314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.568182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.568182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.568182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.578413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 974/1965] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:07.582875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.593394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408169-405c-403d-89ca-9ead570a143f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.598201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.602696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.602696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.602696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] PATH_INFO: `/v3/projects/8ac6190e7dc64e90893c653e762b7c76/users/8303bcdeea2649a1a57a61b80ece059d/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.614162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.615939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:07.616097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac6190e7dc64e90893c653e762b7c76, user_id=8303bcdeea2649a1a57a61b80ece059d, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.618955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebda48-e073-4b58-99a5-c7523d7542ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.630739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d1036-616f-457e-9010-317743dfdac3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.635457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.636352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.636636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.636912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] PATH_INFO: `/v3/users/265261f6b0b14ee7b5400615a93e032a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.638093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265261f6b0b14ee7b5400615a93e032a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.640006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.744742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 992/1966] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:07 2022] PUT /identity/v3/projects/8ac6190e7dc64e90893c653e762b7c76/users/8303bcdeea2649a1a57a61b80ece059d/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:07.756867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.757158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.757481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.790878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] MFA Rules not processed for user `8303bcdeea2649a1a57a61b80ece059d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:07.792156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:07.948291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265261f6b0b14ee7b5400615a93e032a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:07.948291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265261f6b0b14ee7b5400615a93e032a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:07.948291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265261f6b0b14ee7b5400615a93e032a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:07.949577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 993/1967] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:07.949577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:07.949577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744ccc6-c7b5-486a-80ba-815434a8ce8a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:07.950508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:07.951174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.951465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.951747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:07.952488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:07.954746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:07.972644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265261f6b0b14ee7b5400615a93e032a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:07.972954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:07.973609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db2b5eb4-a5dd-47af-a2d5-1dc1cafa5537 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265261f6b0b14ee7b5400615a93e032a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:07.980031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 975/1968] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:07 2022] DELETE /identity/v3/users/265261f6b0b14ee7b5400615a93e032a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:07.985131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:07.985426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:07.985708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.004977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:08.004977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.063715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 976/1969] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:08.073233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.077607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.077738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 994/1970] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:07 2022] POST /identity/v3/projects => generated 391 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:08.080420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.081995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.134752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d0cd-5e19-43d9-944d-4ef4399687ad None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.151217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133be9-1776-416f-bca4-cb5c90a0ddbe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.158066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.161215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.161215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.161215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.161215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.162397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.189496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.190154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.190440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.190747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.199866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.201344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.211478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 977/1971] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:08.276619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 995/1972] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:08 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:08.277801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.288815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3066bfb1-4506-44c2-a36e-2ea0a891dc9b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.294332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.294948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.295240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.295518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.296363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.298059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.309073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 978/1973] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:08.313936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.324622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2501e99-f301-46bf-bceb-451506c2ce03 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.330497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.331412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.331702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.331979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] PATH_INFO: `/v3/projects/689af6abf78c46d685ec6b0078942fe1/users/9e71f1e1460e4fb58015ccd528ab2440/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.347537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689af6abf78c46d685ec6b0078942fe1, user_id=9e71f1e1460e4fb58015ccd528ab2440, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.350240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.418719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 996/1974] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:08 2022] PUT /identity/v3/projects/689af6abf78c46d685ec6b0078942fe1/users/9e71f1e1460e4fb58015ccd528ab2440/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:08.423363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.435961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d9a1f-3c89-4432-bd15-b3d70dd5425d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.501310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.502967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.502967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.502967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.503918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.505892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.521433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.523426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.527438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 979/1975] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:08.528441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.540372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53ac47a-a138-4728-a77f-41d698762708 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.540603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d3db9-20f5-4ec4-a455-457d847afa81 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.548035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.549406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.549605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.550025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.550381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] PATH_INFO: `/v3/projects/689af6abf78c46d685ec6b0078942fe1/users/9e71f1e1460e4fb58015ccd528ab2440/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.551040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.551603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.552224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] PATH_INFO: `/v3/users/c96eb8ad9e614a489b31f19fd9f03022` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.552698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689af6abf78c46d685ec6b0078942fe1, user_id=9e71f1e1460e4fb58015ccd528ab2440, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.554132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c96eb8ad9e614a489b31f19fd9f03022)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.556158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a624c-7edf-4e96-9375-33f5a8fc91d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.556396 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.571312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 980/1976] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:08 2022] PUT /identity/v3/projects/689af6abf78c46d685ec6b0078942fe1/users/9e71f1e1460e4fb58015ccd528ab2440/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:08.584727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.585024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.585309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.612755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] MFA Rules not processed for user `9e71f1e1460e4fb58015ccd528ab2440`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:08.613979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.683914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 981/1977] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:08.691803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.693372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.749108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a46c0-9a20-4b51-a804-277b14443f58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.754495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.755156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.755439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.755717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.766384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.767836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.779742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 982/1978] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:08.779742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.782127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.794695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c96eb8ad9e614a489b31f19fd9f03022'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.814005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c96eb8ad9e614a489b31f19fd9f03022'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.828419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c96eb8ad9e614a489b31f19fd9f03022'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.869409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e0f41-a29a-413d-91c3-905c2ab6221e service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.874370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:08.876666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:08.876666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:08.876666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] PATH_INFO: `/v3/projects/40b6c4bf42634ae9b0e56a8d3eb0314c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:08.877010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40b6c4bf42634ae9b0e56a8d3eb0314c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:08.878913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:08.896575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c96eb8ad9e614a489b31f19fd9f03022'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.897197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c96eb8ad9e614a489b31f19fd9f03022'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.903809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 997/1979] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:08 2022] DELETE /identity/v3/users/c96eb8ad9e614a489b31f19fd9f03022 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:08.904536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:08.906493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:08.914916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:08.973778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79527b9d-9f90-4698-8a87-bb65f8b5df27 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:08.979529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40b6c4bf42634ae9b0e56a8d3eb0314c', 'request_id': 'req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:08.989112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40b6c4bf42634ae9b0e56a8d3eb0314c', 'request_id': 'req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.036075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:09.036075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.036075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.036075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] PATH_INFO: `/v3/users/1110701263114125ac448ef55dd6753d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.036611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1110701263114125ac448ef55dd6753d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:09.038690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:09.052090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40b6c4bf42634ae9b0e56a8d3eb0314c', 'request_id': 'req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.063347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] The token cache is being invalidate because project 40b6c4bf42634ae9b0e56a8d3eb0314c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:09.063715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.064613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.066245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 983/1980] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:08 2022] DELETE /identity/v3/projects/40b6c4bf42634ae9b0e56a8d3eb0314c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:09.069786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:09.071129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.128429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cd3f6-594a-451c-8495-95dc9bf3d0c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:09.133226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:09.133884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.134174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.134455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.136324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.197481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:09.198985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553d216c-85e5-4811-9b67-c2be1e2cf2b6 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:09.208033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 984/1981] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:09.209479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.209773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.210052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.227538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:09.228950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.237440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1110701263114125ac448ef55dd6753d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.238610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 985/1982] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:09.239670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:09.241465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.254804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1110701263114125ac448ef55dd6753d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.254956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d8fae9-4d80-4a7f-951a-0c7b18190a4e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:09.260454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:09.261530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.261666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.261877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] PATH_INFO: `/v3/users/12b3756a1e78447c9bf2788ce176d113` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.263287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12b3756a1e78447c9bf2788ce176d113)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:09.264798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1110701263114125ac448ef55dd6753d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.265407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:09.364586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1110701263114125ac448ef55dd6753d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.365241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1110701263114125ac448ef55dd6753d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.371860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 998/1983] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:08 2022] DELETE /identity/v3/users/1110701263114125ac448ef55dd6753d => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:09.372447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:09.374588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.432309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d6e28-dff5-439d-bc0f-773e08b5aeaf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:09.437108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:09.438098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.438382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.438658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.440512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.499265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:09.511320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:09.511320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e265157-3fdf-452c-ae57-4f4cb824e9ac service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:09.525880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 999/1984] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:09.527422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.527780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.528386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.566635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12b3756a1e78447c9bf2788ce176d113'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.617622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:09.617622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:09.618196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12b3756a1e78447c9bf2788ce176d113'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.618385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1000/1985] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:09.625484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12b3756a1e78447c9bf2788ce176d113'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.647660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:09.658973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e532e27-40fc-49c3-a31f-29c9ec4fb78f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:09.663380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:09.664537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:09.665045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:09.665519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:09.684609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:09.687032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:09.713452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1001/1986] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:09.766830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12b3756a1e78447c9bf2788ce176d113'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.767467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12b3756a1e78447c9bf2788ce176d113'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:09.775881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 986/1987] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:09 2022] DELETE /identity/v3/users/12b3756a1e78447c9bf2788ce176d113 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:10.316926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:10.318584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:10.332016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f754ef-1889-444e-8300-40508ecb3155 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:10.395482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:10.395482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:10.416909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:10.418016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.418306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.418583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] PATH_INFO: `/v3/projects/011c11b507184d7aa8bd03360f67c929` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.421038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=011c11b507184d7aa8bd03360f67c929)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:10.424622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:10.470235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37888d99-e69b-42c6-b4ac-983bdd062e1e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:10.475042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:10.475971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.476285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.476566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] PATH_INFO: `/v3/projects/162902362436474a9264523bbc8d8481` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.477791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162902362436474a9264523bbc8d8481)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:10.479719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:10.578925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '011c11b507184d7aa8bd03360f67c929', 'request_id': 'req-419c331e-5613-4739-8e9b-5335fc9985e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.585898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '011c11b507184d7aa8bd03360f67c929', 'request_id': 'req-419c331e-5613-4739-8e9b-5335fc9985e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.606997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162902362436474a9264523bbc8d8481', 'request_id': 'req-641eaa2d-48a1-4cec-80dc-44b77df734b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.613683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162902362436474a9264523bbc8d8481', 'request_id': 'req-641eaa2d-48a1-4cec-80dc-44b77df734b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.663287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '011c11b507184d7aa8bd03360f67c929', 'request_id': 'req-419c331e-5613-4739-8e9b-5335fc9985e9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.674384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] The token cache is being invalidate because project 011c11b507184d7aa8bd03360f67c929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:10.674673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.675289 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.676856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1002/1988] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:10 2022] DELETE /identity/v3/projects/011c11b507184d7aa8bd03360f67c929 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:10.677622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:10.678891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:10.739807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c331e-5613-4739-8e9b-5335fc9985e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:10.744545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162902362436474a9264523bbc8d8481', 'request_id': 'req-641eaa2d-48a1-4cec-80dc-44b77df734b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.759520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:10.761002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] The token cache is being invalidate because project 162902362436474a9264523bbc8d8481 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:10.761300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.762114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.764664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 987/1989] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:10 2022] DELETE /identity/v3/projects/162902362436474a9264523bbc8d8481 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:10.765865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:10.767546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:10.800389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:10.801272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.801552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.801829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] PATH_INFO: `/v3/projects/f163137e1c294addb7770264901b17e2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.803030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f163137e1c294addb7770264901b17e2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:10.804967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:10.849221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641eaa2d-48a1-4cec-80dc-44b77df734b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:10.853817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:10.854694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:10.854976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:10.855253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] PATH_INFO: `/v3/users/6d4cc7774e3e41f6b7d968f1367e076a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:10.856836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d4cc7774e3e41f6b7d968f1367e076a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:10.859481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:10.931010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f163137e1c294addb7770264901b17e2', 'request_id': 'req-f5c22856-5772-4cf5-b455-b737d8a54a95'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:10.938406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f163137e1c294addb7770264901b17e2', 'request_id': 'req-f5c22856-5772-4cf5-b455-b737d8a54a95'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.027782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f163137e1c294addb7770264901b17e2', 'request_id': 'req-f5c22856-5772-4cf5-b455-b737d8a54a95'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.040214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] The token cache is being invalidate because project f163137e1c294addb7770264901b17e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:11.040509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.041179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.042769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1003/1990] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:10 2022] DELETE /identity/v3/projects/f163137e1c294addb7770264901b17e2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:11.043574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.045065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.059590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:11.077357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d4cc7774e3e41f6b7d968f1367e076a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.093516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d4cc7774e3e41f6b7d968f1367e076a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.105367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d4cc7774e3e41f6b7d968f1367e076a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.122910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c22856-5772-4cf5-b455-b737d8a54a95 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.127609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.128521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.128812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.129112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] PATH_INFO: `/v3/users/be05440d104e4b5a9d15d247036a10eb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.130308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=be05440d104e4b5a9d15d247036a10eb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.132277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.233877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d4cc7774e3e41f6b7d968f1367e076a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.234901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ccf77704-3e21-4384-a54f-1dfcfd8f8e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d4cc7774e3e41f6b7d968f1367e076a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.242235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 988/1991] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:10 2022] DELETE /identity/v3/users/6d4cc7774e3e41f6b7d968f1367e076a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:11.243744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ba31-e8ef-46d1-86c2-24239398d81d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.244143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ba31-e8ef-46d1-86c2-24239398d81d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.244887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1ba31-e8ef-46d1-86c2-24239398d81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.307526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-81e1ba31-e8ef-46d1-86c2-24239398d81d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:11.308894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81e1ba31-e8ef-46d1-86c2-24239398d81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.368081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be05440d104e4b5a9d15d247036a10eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.372029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 989/1992] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:11.383981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.383981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.383981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.387629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be05440d104e4b5a9d15d247036a10eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.396241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be05440d104e4b5a9d15d247036a10eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.401082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:11.402372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.411250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 990/1993] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:11.415387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.424374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d51209-5623-4fe1-b9bd-f7715436b5fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.429081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.429724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.430009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.430287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.431008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:11.431318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.432940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.444643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 991/1994] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:22:11.448724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.461934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59125e-2770-4e30-a8aa-1c4fb6ca4af3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.468728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.469765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.470163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.470538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.471697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.474492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.475794 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be05440d104e4b5a9d15d247036a10eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.477374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be05440d104e4b5a9d15d247036a10eb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.487694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1004/1995] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:11 2022] DELETE /identity/v3/users/be05440d104e4b5a9d15d247036a10eb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:11.620207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 992/1996] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:11 2022] POST /identity/v3/projects => generated 377 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:11.624290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.625725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.688859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cde454-2b25-4641-8dd2-e9641baf2bea admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.716510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.719039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:11.762459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.763166 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.763453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.763723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.765542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.767657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.800576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028587f-dc68-44db-ab12-0468807918a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.805506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.806441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.806885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.807166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] PATH_INFO: `/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.809701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12f7817ad574118af1ffb0dd18b3f2f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.812988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.868877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1005/1997] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:11 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:11.872860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.883577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f201a7-a737-4644-9ef1-95ad5e0456af admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.900940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:11.901894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:11.902389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:11.903075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:11.904215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:11.905935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:11.917300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1006/1998] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:11.921582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:11.935410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a37939d-533b-400d-b824-ab911cd597d1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:11.940357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12f7817ad574118af1ffb0dd18b3f2f', 'request_id': 'req-96fea151-93ca-4fbb-a20f-b3094b51e76f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.947517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12f7817ad574118af1ffb0dd18b3f2f', 'request_id': 'req-96fea151-93ca-4fbb-a20f-b3094b51e76f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:11.996352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:12.013370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.013370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.013637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.013922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.015417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.019653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.030284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1007/1999] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:12.041775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.041911 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12f7817ad574118af1ffb0dd18b3f2f', 'request_id': 'req-96fea151-93ca-4fbb-a20f-b3094b51e76f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.057721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] The token cache is being invalidate because project c12f7817ad574118af1ffb0dd18b3f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:12.057958 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.059203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.065006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 993/2000] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:11 2022] DELETE /identity/v3/projects/c12f7817ad574118af1ffb0dd18b3f2f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:12.065006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.065006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.066416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2810-8a7a-4285-9b56-6bb9b3be463b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.071665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.072673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.072969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.076646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] PATH_INFO: `/v3/projects/94ba3def95be4a95aa082c9a28b72984/users/205b47c3f5614077a1d5935caaceb3e0/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.080017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fea151-93ca-4fbb-a20f-b3094b51e76f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.086999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.088164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.088571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.088939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] PATH_INFO: `/v3/projects/6ef13c400da34b57ab0f092433f59578` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.090517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef13c400da34b57ab0f092433f59578)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.091027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ba3def95be4a95aa082c9a28b72984, user_id=205b47c3f5614077a1d5935caaceb3e0, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.093468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.093767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebbb34-3ba2-4e87-b5fc-8a761da27823 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.200475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1008/2001] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:12 2022] PUT /identity/v3/projects/94ba3def95be4a95aa082c9a28b72984/users/205b47c3f5614077a1d5935caaceb3e0/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:12.200475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47315-dfd4-4b01-be65-f0571b47d59f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.200475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47315-dfd4-4b01-be65-f0571b47d59f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.200475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47315-dfd4-4b01-be65-f0571b47d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.229397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f8e47315-dfd4-4b01-be65-f0571b47d59f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:12.230607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f8e47315-dfd4-4b01-be65-f0571b47d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.246720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef13c400da34b57ab0f092433f59578', 'request_id': 'req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.256227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef13c400da34b57ab0f092433f59578', 'request_id': 'req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.292253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1009/2002] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:12.293689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62509b-dbb9-4612-8a37-0898183ea8c8 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.293974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62509b-dbb9-4612-8a37-0898183ea8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.294259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62509b-dbb9-4612-8a37-0898183ea8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.315284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef13c400da34b57ab0f092433f59578', 'request_id': 'req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.326080 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7b62509b-dbb9-4612-8a37-0898183ea8c8 None None] MFA Rules not processed for user `205b47c3f5614077a1d5935caaceb3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:12.326985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] The token cache is being invalidate because project 6ef13c400da34b57ab0f092433f59578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:12.327285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.327658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b62509b-dbb9-4612-8a37-0898183ea8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.327920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec5ea6a2-2326-4ab9-8fe0-8d87eaf2923c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:12.329823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 994/2003] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:12 2022] DELETE /identity/v3/projects/6ef13c400da34b57ab0f092433f59578 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:12.332109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99d5e-a4c6-4cd7-acf8-9d5ecb42948d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.332109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99d5e-a4c6-4cd7-acf8-9d5ecb42948d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.332109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b99d5e-a4c6-4cd7-acf8-9d5ecb42948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.348925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b8b99d5e-a4c6-4cd7-acf8-9d5ecb42948d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:12.350123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8b99d5e-a4c6-4cd7-acf8-9d5ecb42948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.362454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 995/2004] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:12.364150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.364454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.364719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.386632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:12.387845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.401011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 996/2005] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:12.402150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.414576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1010/2006] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:12.415936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.416249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.416527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.418463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e5a94-0dd0-458a-bd3b-988a1c883483 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.424716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.425485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.425772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.426055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.426785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:12.427099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.428829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.438725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:12.439990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.442627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 997/2007] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:12.443759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.445620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:12.449637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1011/2008] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:12.450580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.461039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ba65a8-cc21-4357-bf2e-23bc84b92c5a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.462635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db9f61-8aae-410e-b0ee-b3ad5a584051 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.472378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.473453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.473746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.474137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.474676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.474955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.475070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.475467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.475667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.476488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.477617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.479315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.615419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1012/2009] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/projects => generated 389 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:12.615905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 998/2010] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:12.616290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.619632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.678522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af9865-6455-408b-a3c3-ff0e22862b42 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.681066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14804b63-9dde-4b48-8089-a653e9bdaae3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.683135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.683800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.684085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.687695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.687695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:12.687695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.687954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.687954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.687954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.688245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.688335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.688335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.690045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.700185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1013/2011] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:12.701092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.712222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532274ea-8b85-437c-9c5e-5c22b6deb7a6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.716850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.718237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.718524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.718903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.719484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.721498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.793782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 999/2012] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:12.794597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.804802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fd10c-3019-43ad-9483-d05e22144a16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.809458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.810083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.810364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.810638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.811311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.813228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.823987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1014/2013] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/users => generated 296 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:12.825031 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.835446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053e553-4819-4cad-9189-0c0cd85f0cc4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.840456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.841223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.841507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.841782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.843104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.844808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.854880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1015/2014] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:12.855823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.865118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5569470e-96a7-4750-8135-0ce54d166e9c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.869855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.870291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.870574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.870851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.871551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.873163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.883131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1016/2015] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:12.883979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.894176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b43a1-65d3-4b4b-ab4f-c10bbe3c18f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.898756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.899392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.899679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.899959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.900765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.902315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.913470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1017/2016] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:12.914261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.923538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac016e07-6384-4d89-9d43-95af11dc969d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.928092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.933419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.933419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:12.933419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] PATH_INFO: `/v3/projects/f6a23ff0f25f417199b7552e59ca448a/users/e7a50761319c43da8f690db3065514b0/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:12.933691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1000/2017] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:12 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:12.933691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:12.946500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a23ff0f25f417199b7552e59ca448a, user_id=e7a50761319c43da8f690db3065514b0, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:12.949303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:12.993669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66b432-f5a4-46e8-a348-01fcad944632 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:12.998641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:12.999536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:12.999869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.000134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] PATH_INFO: `/v3/projects/a18e0aef307f4e1291317924f618e3fe/users/6694228a81644dd499b7fd39acab56ce/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.014922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18e0aef307f4e1291317924f618e3fe, user_id=6694228a81644dd499b7fd39acab56ce, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.017742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.064189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1018/2018] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:12 2022] PUT /identity/v3/projects/f6a23ff0f25f417199b7552e59ca448a/users/e7a50761319c43da8f690db3065514b0/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:13.065044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.082047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:13.088654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1001/2019] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:12 2022] PUT /identity/v3/projects/a18e0aef307f4e1291317924f618e3fe/users/6694228a81644dd499b7fd39acab56ce/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:13.089453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.128713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d9e32-3dc7-4728-9e6e-da056ab0820d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.149066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b801ff4-1400-4692-ad39-ff405bbfb4f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.153863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.154730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.155441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.155675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.156429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.158028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a290e-2b6f-4a33-a96d-4d67ad2a9a56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.169297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1002/2020] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:13.170588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.170849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.171124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.186042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.186729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.187021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.187446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.188065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.190042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.198501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] MFA Rules not processed for user `6694228a81644dd499b7fd39acab56ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:13.199770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.262011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1003/2021] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:13.262942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.264133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1019/2022] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:13.268585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.278235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee57dc-7d70-4484-9b0a-a2bf6d93aaa3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.279319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2bdf8-231b-45f1-b3b8-953981e873e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.283714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.284363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.285033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.285351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.285646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.286065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.286258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.286538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] PATH_INFO: `/v3/projects/f6a23ff0f25f417199b7552e59ca448a/users/e7a50761319c43da8f690db3065514b0/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.286763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.289140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a23ff0f25f417199b7552e59ca448a, user_id=e7a50761319c43da8f690db3065514b0, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.289804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.292136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.305275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1004/2023] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:13 2022] PUT /identity/v3/projects/f6a23ff0f25f417199b7552e59ca448a/users/e7a50761319c43da8f690db3065514b0/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:13.306246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.371580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc25a82-44e9-4082-9459-7b1ebebe826c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.376884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.377557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.377846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.378127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.378947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.381317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a7250-0173-415c-8525-2903f83d9fd0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.385486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:13.396036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1005/2024] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:13.396244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1020/2025] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:13.396364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.396364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.396364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.397307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.423786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] MFA Rules not processed for user `e7a50761319c43da8f690db3065514b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:13.425767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.469698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429b6c-9c68-47ec-a470-39050cd0215b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.475481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.476188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.476477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.476834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.477541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.479138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.492560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1021/2026] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:13.492560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.504609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f3203-b60a-46ba-914d-36b2a857bab6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.510190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.510873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.511162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.511433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.512258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.514948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.527399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1006/2027] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:13.529224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.542666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0bc6c-46c5-4917-b91c-ac17b92df21c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.547405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.549057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.549346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.554657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] PATH_INFO: `/v3/projects/a696b2cf4ea149eb8317efad36bb86d8/users/ab1e3a3da8284116bd6227953c74f247/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.564986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a696b2cf4ea149eb8317efad36bb86d8, user_id=ab1e3a3da8284116bd6227953c74f247, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.567617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.614312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1022/2028] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:13.614312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.614312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.638160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1007/2029] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:13 2022] PUT /identity/v3/projects/a696b2cf4ea149eb8317efad36bb86d8/users/ab1e3a3da8284116bd6227953c74f247/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:13.638160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.674747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044e77f-787e-45b3-a299-36c5a72c6d93 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.700465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca6d7f-ea29-4ab5-867e-b4b51d10d1a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.706273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.707189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.707781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.708283 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.709025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.710635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde05eeb-8c0b-4ae5-b8fd-f6a526df5698 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.720951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1008/2030] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:13.722282 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.722577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.724240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.728200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.728871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.729161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.729460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.750857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] MFA Rules not processed for user `ab1e3a3da8284116bd6227953c74f247`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:13.755566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:13.805524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.807110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.839403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1023/2031] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:13.840395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.861806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1009/2032] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:13.862741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dbd12-e23f-462f-87d4-82a32c44ea2e service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.874145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.875687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.875903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.876223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] PATH_INFO: `/v3/projects/007030bc3cfe463b8f55cc4575df2ad0/users/91b4626e99f340f986f91c56c8461541/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.893068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:13.896938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007030bc3cfe463b8f55cc4575df2ad0, user_id=91b4626e99f340f986f91c56c8461541, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.901174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.902647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787ace1-9ea2-4f2c-93a8-a1fbd2fe50cb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:13.906641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:13.907320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:13.907602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:13.907875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:13.916875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:13.918342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:13.927989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1010/2033] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:14.005623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1024/2034] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:13 2022] PUT /identity/v3/projects/007030bc3cfe463b8f55cc4575df2ad0/users/91b4626e99f340f986f91c56c8461541/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:14.009725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:14.021115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9231cff-ba51-4cfd-beae-c45613ed3206 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:14.084255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:14.085033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.085393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.085742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.086561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:14.088371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3a4c1-7e82-4aaf-b987-d06b79b30775 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:14.098822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1011/2035] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:14.103021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:14.115241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6866-ea22-493f-ae9e-b7035c643724 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:14.119929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:14.120841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.121129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.121413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] PATH_INFO: `/v3/projects/007030bc3cfe463b8f55cc4575df2ad0/users/91b4626e99f340f986f91c56c8461541/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.123479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=007030bc3cfe463b8f55cc4575df2ad0, user_id=91b4626e99f340f986f91c56c8461541, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:14.126153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:14.136633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1025/2036] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:14 2022] PUT /identity/v3/projects/007030bc3cfe463b8f55cc4575df2ad0/users/91b4626e99f340f986f91c56c8461541/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:14.147768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.147988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.148303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.177456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] MFA Rules not processed for user `91b4626e99f340f986f91c56c8461541`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:14.178818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:14.247728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1012/2037] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:14.548772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:14.550709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:14.589285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:14.591193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:14.740582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:14.742174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907eae95-f8ca-47da-ae0a-b206ba313eef admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:14.742174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:14.742174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.742426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b64609-8f7d-4df6-a1c2-b1c5486c4205 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:14.742512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.742512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] PATH_INFO: `/v3/users/8303bcdeea2649a1a57a61b80ece059d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.742512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8303bcdeea2649a1a57a61b80ece059d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:14.742512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:14.742829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:14.742829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.742829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.742829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.743168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:14.743168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:14.743168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1013/2038] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:14.927008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:14.938423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fe07b-b359-416c-a2d5-8fa80235eff3 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:14.944892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:14.946165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:14.946620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:14.947142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] PATH_INFO: `/v3/users/6694228a81644dd499b7fd39acab56ce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:14.948399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6694228a81644dd499b7fd39acab56ce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:14.950341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:15.060062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8303bcdeea2649a1a57a61b80ece059d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.074025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8303bcdeea2649a1a57a61b80ece059d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.082074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8303bcdeea2649a1a57a61b80ece059d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.132358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8303bcdeea2649a1a57a61b80ece059d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.133403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3397318c-9b21-4144-a9c9-dc7e69e90431 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8303bcdeea2649a1a57a61b80ece059d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.143238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:15.144732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1026/2039] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:14 2022] DELETE /identity/v3/users/8303bcdeea2649a1a57a61b80ece059d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:15.147024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:15.147322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:15.147613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:15.150941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6694228a81644dd499b7fd39acab56ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.165854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6694228a81644dd499b7fd39acab56ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.170099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:15.172249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.173777 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6694228a81644dd499b7fd39acab56ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.235000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6694228a81644dd499b7fd39acab56ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.235860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b9113168-5490-4d3c-b364-07d9b35b1258 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6694228a81644dd499b7fd39acab56ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:15.239606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1027/2040] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:15.249036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1014/2041] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:14 2022] DELETE /identity/v3/users/6694228a81644dd499b7fd39acab56ce => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:15.253235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:15.254208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:15.254517 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:15.254802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:15.255582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.275210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:15.276809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.328053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb836a0b-bfbc-4068-bb11-c14bbc8a703b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:15.361009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1015/2042] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:15.366465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:15.370498 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.382883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:15.384273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:15.384273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:15.384664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:15.387173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.402844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:15.405019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:15.417718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1028/2043] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:15.435656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161298e2-72ee-454d-8f5d-b11d4c6cc755 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:15.439872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:15.440634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:15.440925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:15.441268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:15.452196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:15.453742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:15.464539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1016/2044] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:15.811892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:15.815199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:15.937531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed111a-8727-4af2-90e1-9f5c0dc5e1a3 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:15.945873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a50761319c43da8f690db3065514b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a23ff0f25f417199b7552e59ca448a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:15.947035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:15.947536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:15.947992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:15.949006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:15.952483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:15.952483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:15.990238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1029/2045] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:15.991928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.005295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0ec8d-131c-4d88-b7f1-630e364cbf15 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.018816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a50761319c43da8f690db3065514b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a23ff0f25f417199b7552e59ca448a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.019848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.021205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.021205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.022389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.025018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.162570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.165136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.168707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1017/2046] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:15 2022] POST /identity/v3/projects => generated 354 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:16.177576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.182910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b9585-6d8b-4baa-adf9-7bc5c1adf975 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.252708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.253721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.254002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.254276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] PATH_INFO: `/v3/projects/a18e0aef307f4e1291317924f618e3fe` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.255559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18e0aef307f4e1291317924f618e3fe)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.257523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.260436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d34d22-6a3d-4f4b-abf6-64401cc32b37 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.268445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a50761319c43da8f690db3065514b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a23ff0f25f417199b7552e59ca448a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.269111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.269403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.269683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.270414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:16.270715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.272363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.284783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1018/2047] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:16.285966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.287632 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.301606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1888fbc-8b79-4df0-a14b-77a5cdca78e9 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.306757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.308727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.308727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.308727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] PATH_INFO: `/v3/projects/8ac6190e7dc64e90893c653e762b7c76` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.309362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac6190e7dc64e90893c653e762b7c76)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.311273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.330828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:16.354039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18e0aef307f4e1291317924f618e3fe', 'request_id': 'req-a13ce85b-dde4-46eb-8270-148d10ac50f3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.362720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18e0aef307f4e1291317924f618e3fe', 'request_id': 'req-a13ce85b-dde4-46eb-8270-148d10ac50f3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.441829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac6190e7dc64e90893c653e762b7c76', 'request_id': 'req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.449015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac6190e7dc64e90893c653e762b7c76', 'request_id': 'req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.455987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18e0aef307f4e1291317924f618e3fe', 'request_id': 'req-a13ce85b-dde4-46eb-8270-148d10ac50f3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.475695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] The token cache is being invalidate because project a18e0aef307f4e1291317924f618e3fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:16.476008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.476840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.479420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1030/2048] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:16 2022] DELETE /identity/v3/projects/a18e0aef307f4e1291317924f618e3fe => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:16.480156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.485028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.562717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ce85b-dde4-46eb-8270-148d10ac50f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.584776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac6190e7dc64e90893c653e762b7c76', 'request_id': 'req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.597493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] The token cache is being invalidate because project 8ac6190e7dc64e90893c653e762b7c76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:16.597773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.598403 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.600340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1019/2049] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:16 2022] DELETE /identity/v3/projects/8ac6190e7dc64e90893c653e762b7c76 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:16.601109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.602485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.624423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7a50761319c43da8f690db3065514b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f6a23ff0f25f417199b7552e59ca448a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.625321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.625617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.625890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] PATH_INFO: `/v3/projects/b40fceb9e7524188b77ce708f35e0402` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.627106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b40fceb9e7524188b77ce708f35e0402)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.629163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.666231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1b7fe5-4f93-45a4-8af7-ded0ecbe1bd9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.670995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.672006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.672324 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.672607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] PATH_INFO: `/v3/users/91b4626e99f340f986f91c56c8461541` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.673819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b4626e99f340f986f91c56c8461541)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.675760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:16.737053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40fceb9e7524188b77ce708f35e0402', 'request_id': 'req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.743386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40fceb9e7524188b77ce708f35e0402', 'request_id': 'req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.873426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40fceb9e7524188b77ce708f35e0402', 'request_id': 'req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.884598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] The token cache is being invalidate because project b40fceb9e7524188b77ce708f35e0402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:16.884598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.886906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.888603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1031/2050] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:16 2022] DELETE /identity/v3/projects/b40fceb9e7524188b77ce708f35e0402 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:16.895135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:16.897033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:16.918586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b4626e99f340f986f91c56c8461541'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.938206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b4626e99f340f986f91c56c8461541'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.949786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b4626e99f340f986f91c56c8461541'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:16.971350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e0f7ab-0017-4d0e-a45c-ceeceb88cd09 tempest-VolumeQuotaClassesTest-736587647 tempest-VolumeQuotaClassesTest-736587647-project-admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:16.975950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:16.976880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:16.977167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:16.977440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] PATH_INFO: `/v3/users/9e71f1e1460e4fb58015ccd528ab2440` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:16.978633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e71f1e1460e4fb58015ccd528ab2440)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:16.980663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:17.023334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b4626e99f340f986f91c56c8461541'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.023969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b4626e99f340f986f91c56c8461541'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.050211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1020/2051] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:16 2022] DELETE /identity/v3/users/91b4626e99f340f986f91c56c8461541 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:17.205368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e71f1e1460e4fb58015ccd528ab2440'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.222466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e71f1e1460e4fb58015ccd528ab2440'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.230936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e71f1e1460e4fb58015ccd528ab2440'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.331826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e71f1e1460e4fb58015ccd528ab2440'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.332578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e71f1e1460e4fb58015ccd528ab2440'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:17.339581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1032/2052] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:16 2022] DELETE /identity/v3/users/9e71f1e1460e4fb58015ccd528ab2440 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:17.416555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:17.695725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:17.697168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:17.718464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:17.720661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:17.810533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de46c14-c9f9-4829-8c7a-55d13a45b222 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:17.867324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab55f0d-eb3f-4cb6-a67d-a5f47259f5bf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:17.874601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:17.875633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:17.875927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:17.876253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] PATH_INFO: `/v3/users/205b47c3f5614077a1d5935caaceb3e0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:17.877553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=205b47c3f5614077a1d5935caaceb3e0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:17.879836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:17.889661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:17.890948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:17.891429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:17.891919 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] PATH_INFO: `/v3/projects/007030bc3cfe463b8f55cc4575df2ad0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:17.893870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=007030bc3cfe463b8f55cc4575df2ad0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:17.896088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.063163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007030bc3cfe463b8f55cc4575df2ad0', 'request_id': 'req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.069735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007030bc3cfe463b8f55cc4575df2ad0', 'request_id': 'req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.147468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '205b47c3f5614077a1d5935caaceb3e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.159583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '205b47c3f5614077a1d5935caaceb3e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.162314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:18.165018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007030bc3cfe463b8f55cc4575df2ad0', 'request_id': 'req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.167699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '205b47c3f5614077a1d5935caaceb3e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.177506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] The token cache is being invalidate because project 007030bc3cfe463b8f55cc4575df2ad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:18.177795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.178461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.180024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1021/2053] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:17 2022] DELETE /identity/v3/projects/007030bc3cfe463b8f55cc4575df2ad0 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:18.180953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.182154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.240943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '205b47c3f5614077a1d5935caaceb3e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.241766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-e9422719-44a1-4d2e-b29b-11631856bc0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '205b47c3f5614077a1d5935caaceb3e0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.245566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bc90f-d58f-4c72-8ff3-d06f52edc0dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.256736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1033/2054] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:17 2022] DELETE /identity/v3/users/205b47c3f5614077a1d5935caaceb3e0 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:18.256736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866a6a-1d39-4d3b-b530-e380bab903f8 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.256736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866a6a-1d39-4d3b-b530-e380bab903f8 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.256736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a866a6a-1d39-4d3b-b530-e380bab903f8 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.257023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.257023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.257023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.257023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] PATH_INFO: `/v3/projects/689af6abf78c46d685ec6b0078942fe1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.257331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1034/2055] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:22:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:22:18.257408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689af6abf78c46d685ec6b0078942fe1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.257485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839d48-ddff-4a6f-9cda-eb4fb03e9d4d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.257485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839d48-ddff-4a6f-9cda-eb4fb03e9d4d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.257485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a839d48-ddff-4a6f-9cda-eb4fb03e9d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.257689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.284547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9a839d48-ddff-4a6f-9cda-eb4fb03e9d4d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.284547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9a839d48-ddff-4a6f-9cda-eb4fb03e9d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.341303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1035/2056] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.342693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.342989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.343277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.361494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.362706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.375900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689af6abf78c46d685ec6b0078942fe1', 'request_id': 'req-8623e1cb-f28e-41d8-8cc6-f761f4afed03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.384713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689af6abf78c46d685ec6b0078942fe1', 'request_id': 'req-8623e1cb-f28e-41d8-8cc6-f761f4afed03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.424507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1036/2057] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.425375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.426659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.439582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf53be1-c836-44b2-a3c4-7d77332a45bc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.444073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.444975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.445258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.445533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] PATH_INFO: `/v3/users/e146659a88964a23bc7113166311b943` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.446726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e146659a88964a23bc7113166311b943)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.448720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.456080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689af6abf78c46d685ec6b0078942fe1', 'request_id': 'req-8623e1cb-f28e-41d8-8cc6-f761f4afed03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.468946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] The token cache is being invalidate because project 689af6abf78c46d685ec6b0078942fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:18.469544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.470538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8623e1cb-f28e-41d8-8cc6-f761f4afed03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.472345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1022/2058] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:18 2022] DELETE /identity/v3/projects/689af6abf78c46d685ec6b0078942fe1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:18.473435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985be3-c057-4db5-9c37-2d3ad175f3ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.473722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985be3-c057-4db5-9c37-2d3ad175f3ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.473995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985be3-c057-4db5-9c37-2d3ad175f3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.493609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-03985be3-c057-4db5-9c37-2d3ad175f3ad None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.496799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-03985be3-c057-4db5-9c37-2d3ad175f3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.557575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1023/2059] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.558930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.559225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.559509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.577444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.578757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.586770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1024/2060] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.587540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.588751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.643561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8f5a0-b960-44ed-88b1-ad11bdc3a8d8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.647313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.647953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.648278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.648559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.650412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.652827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e146659a88964a23bc7113166311b943'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.663125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.664606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07512857-6cd0-45cc-877f-571b3c25e89f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.665515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e146659a88964a23bc7113166311b943'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.672979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e146659a88964a23bc7113166311b943'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.678082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1025/2061] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:18.678082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.678082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.678082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.694710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.695909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.704314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1026/2062] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.704941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.706175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.720652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfaa36c-4322-4c6d-aadf-1e7dc9be353f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.726079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.728742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.728742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.728742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.736580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.738148 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.747964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1027/2063] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:18.748820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.749964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e146659a88964a23bc7113166311b943'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.751120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-aebc0ad0-85a9-475a-8619-04cbb7953cd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e146659a88964a23bc7113166311b943'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:18.759316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6017f0-e2f4-4c6e-a88b-cd7b9a991345 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.760326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1037/2064] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:18 2022] DELETE /identity/v3/users/e146659a88964a23bc7113166311b943 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:18.761710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.762082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.762416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.797436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:18.798595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.843090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.847416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.860254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1028/2065] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:18.864561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.871821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1038/2066] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:18.873156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:18.875843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.887793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882951-6f76-4ac2-adc1-4b47e65ec7f7 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.888745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f00eb-b5c1-49b2-aecb-d7ffcf91e25e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.894679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.894923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.895341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.895750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.896072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.896280 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.896706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.896908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.897284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.898177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:18.898654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.898814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.901375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:18.931165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1039/2067] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:22:18.935614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:18.946875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ae66e-8969-4d1d-8b81-decff92dc8ec admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:18.956296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:18.957200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:18.959621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:18.959983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:18.960764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:18.962775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.001841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1029/2068] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:19.005667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.061057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1040/2069] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:18 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:19.061959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.065510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.082989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19af0e8-2381-444a-a559-33571641f539 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.139864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237e1a-35a8-4f35-8805-69df18444e73 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.144783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.145797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.146156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.146507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] PATH_INFO: `/v3/projects/11f4126274c8408b86ff4cf5b39ca4c5` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.147810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f4126274c8408b86ff4cf5b39ca4c5)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.149336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.149900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.150747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.151103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.151448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.152256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.154386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.261824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1030/2070] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:19 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:19.266463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.273671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f4126274c8408b86ff4cf5b39ca4c5', 'request_id': 'req-ad945480-b824-429b-a3d6-6f0e8e6f0a51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.275970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f9c08-f7ce-4696-ba12-b46bfe5fba8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.280382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f4126274c8408b86ff4cf5b39ca4c5', 'request_id': 'req-ad945480-b824-429b-a3d6-6f0e8e6f0a51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.332257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.332926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.333213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.333496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.334178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.336183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.378175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f4126274c8408b86ff4cf5b39ca4c5', 'request_id': 'req-ad945480-b824-429b-a3d6-6f0e8e6f0a51'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.390625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] The token cache is being invalidate because project 11f4126274c8408b86ff4cf5b39ca4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:19.390921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.391587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.396628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1041/2071] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:19 2022] DELETE /identity/v3/projects/11f4126274c8408b86ff4cf5b39ca4c5 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:19.396628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.396628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.408446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad945480-b824-429b-a3d6-6f0e8e6f0a51 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.413107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.413961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.415702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.415702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] PATH_INFO: `/v3/projects/94ba3def95be4a95aa082c9a28b72984` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.415913 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ba3def95be4a95aa082c9a28b72984)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.417798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.441077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1031/2072] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:19 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:19.441786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.443344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.455416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc5ec0a-e7e9-4b19-b722-1c35830af8d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.461795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.462458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.462791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.463065 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.463815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.465484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db30454-3ed1-4d75-b8a3-864725dd996f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.475685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1032/2073] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:19.476888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.477185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.477459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.494629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:19.495836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.508913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1033/2074] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:19.508913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.510315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.524499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df7ef54-53da-49ea-9610-63f8f6d0b761 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.532271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.533425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.533912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.534347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.535372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.537268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.548091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1034/2075] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:19.549157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.559575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771919d-dcf3-4aef-a301-69eb3a510277 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.563526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ba3def95be4a95aa082c9a28b72984', 'request_id': 'req-a0a2ff64-01b4-4307-83bb-058153a8c519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.570653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ba3def95be4a95aa082c9a28b72984', 'request_id': 'req-a0a2ff64-01b4-4307-83bb-058153a8c519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.612683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:19.619955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.620664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.621066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.621345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.622074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.624342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6728dffe-6e35-48f6-bd84-27364081d74d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.634935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ba3def95be4a95aa082c9a28b72984', 'request_id': 'req-a0a2ff64-01b4-4307-83bb-058153a8c519'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.635130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1035/2076] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:19.636603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.636943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.637158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.647849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] The token cache is being invalidate because project 94ba3def95be4a95aa082c9a28b72984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:19.651817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.651817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.651817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1042/2077] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:19 2022] DELETE /identity/v3/projects/94ba3def95be4a95aa082c9a28b72984 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:19.651817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.653293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.655297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:19.656550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.666654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1036/2078] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:19.668246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ff64-01b4-4307-83bb-058153a8c519 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.678122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.678122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.678886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.678886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.678886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.678886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.679212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.679687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.685074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ecb73d-2a7c-401f-a14b-46215d3b5750 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.690501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.693966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1043/2079] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:19.694114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.694114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.694383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.694485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] PATH_INFO: `/v3/projects/5a653a0f9ff34d1887ec7ebf1f8336a6/users/19fd61e7c2b1468197e93949add14ccf/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.694572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:19.706828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31340fcc-f369-4d22-82d4-3d9c41ce09e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.707912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a653a0f9ff34d1887ec7ebf1f8336a6, user_id=19fd61e7c2b1468197e93949add14ccf, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.710364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.711793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.712697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.713020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.713411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] PATH_INFO: `/v3/users/e7a50761319c43da8f690db3065514b0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.714582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7a50761319c43da8f690db3065514b0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.716533 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.788908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1037/2080] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:19 2022] PUT /identity/v3/projects/5a653a0f9ff34d1887ec7ebf1f8336a6/users/19fd61e7c2b1468197e93949add14ccf/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:19.789671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.853031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba4c77-a26b-49ee-84f1-4f72b08be364 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.858392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.859112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.859388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.859666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.860426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:19.864918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.864918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.874448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1038/2081] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:19.875239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:19.888325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2404d4-b017-44b1-a477-3b67260b12b1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:19.895098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:19.895982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:19.896294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:19.896569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] PATH_INFO: `/v3/projects/9af1057ef88e4ae2aba37b90a30a5af4/users/4e2e7a78e68345e19fc7c3cc9b334d58/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:19.898363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7a50761319c43da8f690db3065514b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.909040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:19.910989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7a50761319c43da8f690db3065514b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.916401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af1057ef88e4ae2aba37b90a30a5af4, user_id=4e2e7a78e68345e19fc7c3cc9b334d58, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:19.916401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe674b-9135-4a45-a31a-29e15ad654bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:19.917749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7a50761319c43da8f690db3065514b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.992999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7a50761319c43da8f690db3065514b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.993650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7a50761319c43da8f690db3065514b0'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:19.998931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1039/2082] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:19 2022] PUT /identity/v3/projects/9af1057ef88e4ae2aba37b90a30a5af4/users/4e2e7a78e68345e19fc7c3cc9b334d58/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:20.000398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc258ea-2198-4a28-984f-383a8f8210ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.000542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1044/2083] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:19 2022] DELETE /identity/v3/users/e7a50761319c43da8f690db3065514b0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:20.001461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.002988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.003908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc258ea-2198-4a28-984f-383a8f8210ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.004239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc258ea-2198-4a28-984f-383a8f8210ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.032246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ebc258ea-2198-4a28-984f-383a8f8210ce None None] MFA Rules not processed for user `19fd61e7c2b1468197e93949add14ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:20.033459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ebc258ea-2198-4a28-984f-383a8f8210ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.072287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88a67b-ddcc-48a2-9083-1700f5febfd1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.078150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.078731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.079020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.079305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.080037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.082084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.102837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1040/2084] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:20.104176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.104471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.104748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.122315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:20.123512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.131093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1041/2085] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:20.131903 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.133110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.185888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1045/2086] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:20.186941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.189106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.193788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ce319-10cf-466a-913b-68f03a1d49eb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.252490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.253146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.253322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd71dbf-dd5e-4fdf-983e-5d0016f543b4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.253426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.253690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.257538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.258200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.258514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.258884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.316598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.318129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.328106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1042/2087] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:20.330711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.331674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.336241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.343880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b053b-dd0a-431e-a081-13f4d3d93966 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.345326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1046/2088] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:20.350571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.351974 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.356531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.357489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.358016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.365142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.365142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.365142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.366812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064a891-23b4-4caa-bffd-0eb5368e08c5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.371864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.372782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.373107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.373412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] PATH_INFO: `/v3/users/19fd61e7c2b1468197e93949add14ccf` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.374660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fd61e7c2b1468197e93949add14ccf)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.376642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.480637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:20.487635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1043/2089] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:20.488675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.490949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.504665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185641cb-3357-4dd8-b1c8-2ece45313c00 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.510078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.510942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.514337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.514337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] PATH_INFO: `/v3/projects/f6a23ff0f25f417199b7552e59ca448a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.514337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a23ff0f25f417199b7552e59ca448a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.515152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.630990 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fd61e7c2b1468197e93949add14ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.643178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fd61e7c2b1468197e93949add14ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.651516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fd61e7c2b1468197e93949add14ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.668667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a23ff0f25f417199b7552e59ca448a', 'request_id': 'req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.676570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a23ff0f25f417199b7552e59ca448a', 'request_id': 'req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.730567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fd61e7c2b1468197e93949add14ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.731395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fd61e7c2b1468197e93949add14ccf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.742915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1047/2090] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:20 2022] DELETE /identity/v3/users/19fd61e7c2b1468197e93949add14ccf => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:20.742915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.744660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.820701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38d2c9-432a-4dea-8537-5b420f9d4c78 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.820701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.820701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.821105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.821431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.822229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.823890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecc14a-e971-46ac-98cb-fabdb12958f8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.830439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a23ff0f25f417199b7552e59ca448a', 'request_id': 'req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.835805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1048/2091] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:20.837486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e338-5e26-41ae-aa1a-f8d1eacde8ab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.837846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e338-5e26-41ae-aa1a-f8d1eacde8ab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.841175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1e338-5e26-41ae-aa1a-f8d1eacde8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.853275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] The token cache is being invalidate because project f6a23ff0f25f417199b7552e59ca448a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:20.853761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.854868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:20.860191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1044/2092] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:20 2022] DELETE /identity/v3/projects/f6a23ff0f25f417199b7552e59ca448a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:20.861626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.863138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.863273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e7f1e338-5e26-41ae-aa1a-f8d1eacde8ab None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:20.864619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e7f1e338-5e26-41ae-aa1a-f8d1eacde8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.873930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1049/2093] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:20.875296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.875592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.875877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.896855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:20.896855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.905188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1050/2094] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:20.909815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:20.911655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:20.942453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d77773-2b91-4c1e-a72b-ce9ca02cf496 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.948243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.948928 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.949217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.956270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.957399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:20.959288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edba324-3ed8-4977-9ed5-6672666e3a6d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:20.970409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1045/2095] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:20.971697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.971984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.972288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:20.977787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd3350-e53b-4a96-890e-56fd5d07ec7d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:20.982299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:20.983184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:20.983574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:20.983952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.004315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:21.005684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.005807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.007755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.020225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1046/2096] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:21.020225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.024312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1051/2097] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:21.025367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.027513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d9679f-200b-4ad0-8da1-da08ab694365 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.032154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.033035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.033321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.033593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] PATH_INFO: `/v3/projects/5963ba04ffc349e8816d86d96db339bd/users/bf8eaf5a58894988942c82763975a216/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.035298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebf1e9-b78a-44fc-8d5d-2f5413911402 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.040394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.041061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.041353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.041628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.042389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:21.042693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.044481 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.049603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5963ba04ffc349e8816d86d96db339bd, user_id=bf8eaf5a58894988942c82763975a216, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.052331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b0c3e7-7532-4358-a118-34e166ac27a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.057176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1052/2098] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:21.062258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.072895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d87eb-1afc-4026-b663-350f17a214a0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.078416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.079069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.079357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.079637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.080378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.082272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.149280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1047/2099] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:21 2022] PUT /identity/v3/projects/5963ba04ffc349e8816d86d96db339bd/users/bf8eaf5a58894988942c82763975a216/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:21.159676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.159977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.160293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.189311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] MFA Rules not processed for user `bf8eaf5a58894988942c82763975a216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:21.190562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.197689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1053/2100] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:21.201716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.266169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1048/2101] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:21.270342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.294013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bba34-9a79-4dd6-9b27-f635ee98ddc8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.300847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.301542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.301833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.302117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.303153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.305100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.337918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a971b6-9ed2-4b52-a740-30c4e64f667f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.343327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.344203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.344496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.344776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.346503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.347396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.394951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1054/2102] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:21.398978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.408922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92261f95-c475-4b9c-ac3e-3b69ec7399e9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.413993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.414647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.414934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.415330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.416064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.417684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.430270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1049/2103] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:21.441078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1055/2104] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:21.441567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.442167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.454070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c4692-51e3-47f1-a39b-6ac494b08702 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.534015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50a0c4-01b7-497f-b2b7-e94fc10944b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.543048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.543923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.544331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.544691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.546247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.548288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.549078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.550307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.550720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.551002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.552042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.555098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.562539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:21.564270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1056/2105] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:21.565253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.567429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.580867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6322e8-77e1-4cfd-a983-b1f322ded938 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.586115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.586934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.587222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.587525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] PATH_INFO: `/v3/projects/5a653a0f9ff34d1887ec7ebf1f8336a6` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.595075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a653a0f9ff34d1887ec7ebf1f8336a6)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.595075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.661761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1050/2106] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/users => generated 299 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:21.661761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.669442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce485-e4a1-4d67-88b4-f0bfddaf19a4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.674999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.677629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.677629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.677629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] PATH_INFO: `/v3/projects/fe4d0919af6444c19f1e20556e19a55a/users/1e3bbc3f01ec4be2af15e0a7a3ca5f4f/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.691913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe4d0919af6444c19f1e20556e19a55a, user_id=1e3bbc3f01ec4be2af15e0a7a3ca5f4f, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.694675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.726376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:21.762300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1051/2107] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:21 2022] PUT /identity/v3/projects/fe4d0919af6444c19f1e20556e19a55a/users/1e3bbc3f01ec4be2af15e0a7a3ca5f4f/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:21.763775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:21.780599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a653a0f9ff34d1887ec7ebf1f8336a6', 'request_id': 'req-3ce173e1-e998-4b91-a991-c0fce0e6015f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:21.789127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a653a0f9ff34d1887ec7ebf1f8336a6', 'request_id': 'req-3ce173e1-e998-4b91-a991-c0fce0e6015f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:21.843223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ebc9a-ba2d-4b66-b637-f4eea3a9f497 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:21.877496 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a653a0f9ff34d1887ec7ebf1f8336a6', 'request_id': 'req-3ce173e1-e998-4b91-a991-c0fce0e6015f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:21.898331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] The token cache is being invalidate because project 5a653a0f9ff34d1887ec7ebf1f8336a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:21.898914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:21.899726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3ce173e1-e998-4b91-a991-c0fce0e6015f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:21.901486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1057/2108] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:21 2022] DELETE /identity/v3/projects/5a653a0f9ff34d1887ec7ebf1f8336a6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:21.902988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48209a-28fa-4178-8c06-53c0dc71bbd5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.903530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48209a-28fa-4178-8c06-53c0dc71bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.903982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b48209a-28fa-4178-8c06-53c0dc71bbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.933896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7b48209a-28fa-4178-8c06-53c0dc71bbd5 None None] MFA Rules not processed for user `1e3bbc3f01ec4be2af15e0a7a3ca5f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:21.939161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:21.939840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.940206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.940493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.941384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:21.943076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41030fb-b296-4534-81bc-f148dd24e647 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:21.946807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7b48209a-28fa-4178-8c06-53c0dc71bbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:21.957665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1052/2109] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:21.957665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:21.957665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:21.957665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:21.997685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] MFA Rules not processed for user `4e2e7a78e68345e19fc7c3cc9b334d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:21.998976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.042160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1058/2110] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:22.043551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.043846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.044143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.063288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:22.064599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.073754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1059/2111] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:22.074676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.075924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.083079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1053/2112] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:22.084216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.085518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.089304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092cfb55-1c28-4509-b158-d3bda71745fc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.095313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.096423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.096783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.097135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] PATH_INFO: `/v3/projects/6943eba4064d4dcf973449230a54e8f9/users/aed003db1b1d4f31a44a2882288aa0d7/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.100059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87bb6-f11f-4587-82db-6b4ed3fb44c5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.104738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.105407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.105683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.105960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.106651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.108621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.112182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6943eba4064d4dcf973449230a54e8f9, user_id=aed003db1b1d4f31a44a2882288aa0d7, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.114866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26634b6b-8c74-4e39-b5d9-e4fe0f1e2c4f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.246081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1060/2113] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:22 2022] PUT /identity/v3/projects/6943eba4064d4dcf973449230a54e8f9/users/aed003db1b1d4f31a44a2882288aa0d7/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:22.248603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.252541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.252541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.266162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1054/2114] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:22.267615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.268988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:22.270177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.270383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.329351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248b85-03d8-4d35-9094-cb60d06bbb41 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.333953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.334849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.335211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.335488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.344542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1061/2115] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:22.344542 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.347831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba4a5-e8b6-435f-9136-c8e61d9b640e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.352751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.353517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.353914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.354260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.355026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.356661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.366756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1062/2116] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:22.367863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.378310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8c0986-906e-4dac-a5ae-762902535d58 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.383092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.383737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.384024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.384338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.385018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.386957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6b51d2-6f0a-421e-8a82-dfd287ce4052 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.401218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.402654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.411946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1055/2117] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:22.412768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.422750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fb8b9-d2c5-4e47-8c37-7fa0b76a6890 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.427843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.428520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.428810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.429092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.429817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:22.430128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.431714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.443931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1056/2118] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:22.444733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.454939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacf9dc-0426-448a-add6-934e5d8eb61f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.460194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.461084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.461371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.465429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] PATH_INFO: `/v3/projects/6943eba4064d4dcf973449230a54e8f9/users/aed003db1b1d4f31a44a2882288aa0d7/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.465429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6943eba4064d4dcf973449230a54e8f9, user_id=aed003db1b1d4f31a44a2882288aa0d7, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.466390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.478964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1057/2119] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:22 2022] PUT /identity/v3/projects/6943eba4064d4dcf973449230a54e8f9/users/aed003db1b1d4f31a44a2882288aa0d7/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:22.479845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.492164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1063/2120] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:22.493943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.494884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.494884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.547093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] MFA Rules not processed for user `aed003db1b1d4f31a44a2882288aa0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:22.548465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.554104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0cc78-9d2f-4bae-bcd1-911489101fd6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.559011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.559682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.559968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.560275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.561515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.563477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.620703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1064/2121] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:22.621552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.632593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd979e-ea6f-411b-8a0d-81dcace27432 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.637242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.638250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.638250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.638446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.639206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.640845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.650815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1065/2122] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:22.651669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.653296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:22.666051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1058/2123] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:22.666051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.709236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacafcb3-fd57-46ae-a57c-0ff73bd23d23 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.729535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ced62-825a-4b6c-92a5-72b02130d96d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.734974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.735646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.735990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.736312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.737053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.738665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.749480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1059/2124] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:22.753059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.759916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c47871-bd7d-4800-a30d-38a576a30e38 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.761969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.762672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.762962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.763241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.764885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.765524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.765812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.766089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.766771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.768732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.824306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.825786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.835629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1066/2125] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:22.836536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.846476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094881b-9ba4-42d2-beb3-7a3ac422b239 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.852412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.853413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.853767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.854113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] PATH_INFO: `/v3/projects/a6dba2f7d90e4e1a9a398ef7812cb1a2/users/fe079173784d4aafa967569d8c373f9e/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.865305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1060/2126] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:22 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:22.867461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:22.871538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6dba2f7d90e4e1a9a398ef7812cb1a2, user_id=fe079173784d4aafa967569d8c373f9e, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.874959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.878100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073cbbc-3d34-48ba-a99b-7ca6d8dc3025 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:22.882850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:22.883713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:22.883994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:22.884303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] PATH_INFO: `/v3/users/bf8eaf5a58894988942c82763975a216` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:22.888378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf8eaf5a58894988942c82763975a216)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:22.890343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:22.919234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:22.970940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1067/2127] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:22 2022] PUT /identity/v3/projects/a6dba2f7d90e4e1a9a398ef7812cb1a2/users/fe079173784d4aafa967569d8c373f9e/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:22.971783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.034049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011a915-ad93-4239-96a0-942e1b99695d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.039397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.040066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.040394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.040674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.041400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.043048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf5e14-03a4-47d8-aaf8-3d97fe32ac5d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.053644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1068/2128] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:23.054995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.055310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.055587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.093936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] MFA Rules not processed for user `fe079173784d4aafa967569d8c373f9e`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:23.095451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.102226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf8eaf5a58894988942c82763975a216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:23.113300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf8eaf5a58894988942c82763975a216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:23.120274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf8eaf5a58894988942c82763975a216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:23.172309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1069/2129] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:23.173178 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.184758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab154674-9696-48c0-b0b4-22ba0138ed4f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.189810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.190480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.190766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.193906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.193906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.193906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.205068 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1070/2130] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:23.205972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.217430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf08478-dab9-4216-b00c-b2a9b86d3b75 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.223806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.223806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.224381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.224765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.225556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.227742 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c8072-b640-40eb-9a2a-0a601c794113 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.242501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf8eaf5a58894988942c82763975a216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:23.243341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf8eaf5a58894988942c82763975a216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:23.257459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1061/2131] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:22 2022] DELETE /identity/v3/users/bf8eaf5a58894988942c82763975a216 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:23.258514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.260165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.305079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1071/2132] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:23.306452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.306967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.307131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.323580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:23.324804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.327831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d2918-a683-469b-b8d3-7d415ac22a90 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.399093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1072/2133] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:23.399241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.399940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.400572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.400857 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.401132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] PATH_INFO: `/v3/projects/96ebf55bd33f4afe85fa18a64fdb9354/users/c62aceafd5574ab896e97ba4c2575313/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.401465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.415647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5a0b2-0779-42e2-a6e5-6d530306c5b9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.419681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.420448 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.420738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.421022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.421752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.422862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ebf55bd33f4afe85fa18a64fdb9354, user_id=c62aceafd5574ab896e97ba4c2575313, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.423793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b709a6-b21a-4cb3-bbaf-cabcfc8a727a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.425829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.491834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1062/2134] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:23 2022] PUT /identity/v3/projects/96ebf55bd33f4afe85fa18a64fdb9354/users/c62aceafd5574ab896e97ba4c2575313/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:23.492742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.494276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.543843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1073/2135] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:23.545161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.545630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.545984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.556652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44352ea6-58fb-42bd-a205-4ff1a02e6364 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.560586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.561258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.561546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.561828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.580217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] MFA Rules not processed for user `c62aceafd5574ab896e97ba4c2575313`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:23.581730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:23.626467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.627912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.637755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1063/2136] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:23.638407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.649001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76c013-d362-4dc2-85aa-ddc270091cb5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.651237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1074/2137] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:23.655780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:23.655922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.662695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.663453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.687877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.687877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.687877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.687877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.688386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5b77f-9574-4205-8e1c-61c3878e5eaa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.688386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.688386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.688386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.688738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.688738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.688738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.688974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1064/2138] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:23.690157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.706328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc27d1-e842-4a4e-b2ab-dea5338f9cfa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:23.719064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:23.720543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:23.721163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:23.721584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] PATH_INFO: `/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1/users/bf6f5d26f8a1403c81b3ad310365afe7/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:23.741106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff47a9ea4064e0680ae6e37abe4def1, user_id=bf6f5d26f8a1403c81b3ad310365afe7, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:23.744500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:23.890871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1075/2139] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/projects => generated 373 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:23.896068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1065/2140] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:23 2022] PUT /identity/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1/users/bf6f5d26f8a1403c81b3ad310365afe7/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:23.900644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.900752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:23.985066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4b09e-9c23-45f1-aa20-3f6e4ab444c4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.025360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd457fe2-5462-441a-bc6c-05735c5f9dbd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.031081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.031826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.032217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.032565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.033365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.035039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.048246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1076/2141] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:24.052975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.056783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.057484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.057773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.058130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.058738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.061377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.064196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fef26-a26d-4bcd-a235-f349cbfb7a2e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.070376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.071274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.071572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.071857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] PATH_INFO: `/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1/users/bf6f5d26f8a1403c81b3ad310365afe7/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.080150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff47a9ea4064e0680ae6e37abe4def1, user_id=bf6f5d26f8a1403c81b3ad310365afe7, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.080150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220bdba-8046-40d9-9ad7-ab870e00a26d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.089170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1077/2142] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:24 2022] PUT /identity/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1/users/bf6f5d26f8a1403c81b3ad310365afe7/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:24.099201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e4ca-9712-42b2-8e0b-438747f18d00 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.106360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e4ca-9712-42b2-8e0b-438747f18d00 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.106360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd2e4ca-9712-42b2-8e0b-438747f18d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.126862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3fd2e4ca-9712-42b2-8e0b-438747f18d00 None None] MFA Rules not processed for user `bf6f5d26f8a1403c81b3ad310365afe7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:24.128050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3fd2e4ca-9712-42b2-8e0b-438747f18d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.195997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1066/2143] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:23 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:24.199827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.201730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1078/2144] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:24.207108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.207405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.207736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.210212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8958ce-46ae-4afc-913d-8767c4a66936 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.225972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] MFA Rules not processed for user `4e2e7a78e68345e19fc7c3cc9b334d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:24.227190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.277666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.277666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.277666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.278341 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.278584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.280596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.291445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1079/2145] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:24.292333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.292552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1067/2146] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:24.293500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.297304 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.299829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.314511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313aaf34-594d-4dda-b427-f876b8630598 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.320558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.322848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.322848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.322848 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] PATH_INFO: `/v3/projects/5963ba04ffc349e8816d86d96db339bd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.323139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5963ba04ffc349e8816d86d96db339bd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.325106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.368827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebafc4f3-de26-4888-b3de-f829c689bdab None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.373900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.374558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.374838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.375113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.384622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.386056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.397795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1080/2147] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:24.401027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.414427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fea297-a69a-42d9-8a79-61ea5ffa23fd service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.421122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.421813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.422751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.423043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.423791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.425658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.440324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1081/2148] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:24.441769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.452692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e11a22-3282-41df-ab47-6dd73d504363 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.464290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.465344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.465741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.466107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] PATH_INFO: `/v3/projects/253b7815afac4bb6990df13fad6ed4cd/users/a5d91aba3c594f0cbc688e4f63fa2756/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.482351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=253b7815afac4bb6990df13fad6ed4cd, user_id=a5d91aba3c594f0cbc688e4f63fa2756, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.484434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5963ba04ffc349e8816d86d96db339bd', 'request_id': 'req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:24.485655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.492413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5963ba04ffc349e8816d86d96db339bd', 'request_id': 'req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:24.564651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1082/2149] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:24 2022] PUT /identity/v3/projects/253b7815afac4bb6990df13fad6ed4cd/users/a5d91aba3c594f0cbc688e4f63fa2756/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:24.565955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.572466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.617819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5963ba04ffc349e8816d86d96db339bd', 'request_id': 'req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:24.630530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] The token cache is being invalidate because project 5963ba04ffc349e8816d86d96db339bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:24.630918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:24.631652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1caa85b6-5b80-449e-9afe-08a07a6c9ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:24.637189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5d660-a348-411c-89b6-81d12b513331 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.637358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1068/2150] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:24 2022] DELETE /identity/v3/projects/5963ba04ffc349e8816d86d96db339bd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:24.639001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.639512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.639889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.642667 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.643609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.643958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.644947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.646889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.668598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] MFA Rules not processed for user `a5d91aba3c594f0cbc688e4f63fa2756`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:24.670837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.677078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:24.712453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.714058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.724043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1083/2151] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:24.725123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.727191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.752757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1069/2152] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:24.753866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:24.755577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:24.807609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83cd8c0-8899-4adb-8819-b788dd5c3dee service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.817036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.818680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.818680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.819108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] PATH_INFO: `/v3/users/aed003db1b1d4f31a44a2882288aa0d7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.821638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed003db1b1d4f31a44a2882288aa0d7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.823928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.840028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897765c5-ebcd-44f5-8e3c-7b69301a16fc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:24.845540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:24.846212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:24.846509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:24.846787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:24.847495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:24.849486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:24.945826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1070/2153] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/projects => generated 377 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:24.952376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.069322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e319f0-bb54-417e-b47e-ee1ceda619cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.075778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.079986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.079986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.079986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.079986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.081732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.088536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed003db1b1d4f31a44a2882288aa0d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:25.102905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed003db1b1d4f31a44a2882288aa0d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:25.111940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed003db1b1d4f31a44a2882288aa0d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:25.185050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1071/2154] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:24 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:25.188240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.197657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5470a10-c315-41db-9b19-97ca601514f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.205074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.205747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.206029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.206305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.207034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.211700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed003db1b1d4f31a44a2882288aa0d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:25.211700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed003db1b1d4f31a44a2882288aa0d7'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:25.212102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.216269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1084/2155] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:24 2022] DELETE /identity/v3/users/aed003db1b1d4f31a44a2882288aa0d7 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:25.220322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1072/2156] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:25.229944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.231615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:25.315850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9d9bc-3d0a-4112-8531-adbf2d0e4c18 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.320789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.321809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.322097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.322376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] PATH_INFO: `/v3/projects/75d0217238c84e5d86f9443bd607c3ae/users/e52b33a21eee4877825d62cbe6af6f08/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.339920 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0217238c84e5d86f9443bd607c3ae, user_id=e52b33a21eee4877825d62cbe6af6f08, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.344220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.430872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1085/2157] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:25 2022] PUT /identity/v3/projects/75d0217238c84e5d86f9443bd607c3ae/users/e52b33a21eee4877825d62cbe6af6f08/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:25.436590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.446737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba45514-bf7b-4811-8d9e-ff4331b3e826 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.514187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.514938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.515511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.515880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.516719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.518586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b337f80-fd5c-49a8-87eb-8a3e5b3a56fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.532941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1073/2158] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:25.538662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.559958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b223b1-7ffb-4e5d-9194-1b1122d42a28 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.569837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.570755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.571043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.571324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] PATH_INFO: `/v3/projects/75d0217238c84e5d86f9443bd607c3ae/users/e52b33a21eee4877825d62cbe6af6f08/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.576942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d0217238c84e5d86f9443bd607c3ae, user_id=e52b33a21eee4877825d62cbe6af6f08, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.579063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.591270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1086/2159] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:25 2022] PUT /identity/v3/projects/75d0217238c84e5d86f9443bd607c3ae/users/e52b33a21eee4877825d62cbe6af6f08/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:25.610415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.610985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.611546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.645617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] MFA Rules not processed for user `e52b33a21eee4877825d62cbe6af6f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:25.646829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:25.751685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1074/2160] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:25.766302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.771106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:25.822584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:25.831308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:25.832844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:25.854351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceabf8d-c7e1-438e-92ad-5a30af013f5f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.860384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.860937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.861228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.861551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.864470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:25.925471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812ad3d-b587-42e0-9513-27f196ecd361 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:25.930554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:25.932396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:25.932798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:25.933022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] PATH_INFO: `/v3/projects/6943eba4064d4dcf973449230a54e8f9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:25.934594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6943eba4064d4dcf973449230a54e8f9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.937082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.944316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:25.945903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b5a07-7d9b-4508-9a77-92f58f66b5f7 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:25.956003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1087/2161] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:26.054197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6943eba4064d4dcf973449230a54e8f9', 'request_id': 'req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:26.061735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6943eba4064d4dcf973449230a54e8f9', 'request_id': 'req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:26.143386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6943eba4064d4dcf973449230a54e8f9', 'request_id': 'req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:26.154805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] The token cache is being invalidate because project 6943eba4064d4dcf973449230a54e8f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:26.155056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:26.155713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d85c5f38-aebc-4939-a86f-f2a4e6a655f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:26.157539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1075/2162] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:25 2022] DELETE /identity/v3/projects/6943eba4064d4dcf973449230a54e8f9 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:26.162693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.163163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.163265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.183032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:26.184311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:26.245782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1088/2163] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:26.255151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.255443 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.255783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.275103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:26.276349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:26.284536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1076/2164] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:26.289357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.300106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc90872-82e5-415c-9989-84a9be5857d9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.304922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.305906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.305906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.306158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.306880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:26.307186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.308848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.320877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1089/2165] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:26.325106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.334839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf2f0c-1f21-4bad-835f-8b3c401979d1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.339688 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.340358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.340643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.340916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.341649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.343558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.488044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1077/2166] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:26 2022] POST /identity/v3/projects => generated 367 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:22:26.492346 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.502985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be2368-db6c-4b30-acf7-d892d9ef9caa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.561845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.562564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.562845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.563117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.563818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.566034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.681405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1090/2167] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:26 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:26.682734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.693468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df27206-a279-4666-a706-e24267e6cb1a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.696316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:26.699757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.699757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.699757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.700050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.700917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.703804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.715005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1078/2168] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:26.719556 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.729956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812b6fb-e193-4f44-80cb-90d6e69a0ab5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.737247 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.737933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.738250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.738536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.739281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.741161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c73b36-7ad9-4d7c-be08-255712da7647 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.755832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1091/2169] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:26.760255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:26.767718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af0a37-5fd6-40b0-83e2-34cb71e0f380 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:26.773031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:26.774137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.774610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.774891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] PATH_INFO: `/v3/projects/9924b76da2cd4028991ddf5b99a21c1a/users/0e2fdbc97db14b6689f36c3045310bae/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.797758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9924b76da2cd4028991ddf5b99a21c1a, user_id=0e2fdbc97db14b6689f36c3045310bae, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:26.801207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:26.946731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1079/2170] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:26 2022] PUT /identity/v3/projects/9924b76da2cd4028991ddf5b99a21c1a/users/0e2fdbc97db14b6689f36c3045310bae/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:26.949678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:26.949980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:26.950263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:26.985049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] MFA Rules not processed for user `0e2fdbc97db14b6689f36c3045310bae`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:26.986201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:27.050557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1092/2171] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:27.054722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.115959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b32fdc-f394-42c7-98cf-0026f774ca92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.120673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.121328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.121651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.121879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.122565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.124556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.224108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1080/2172] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:27 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:27.228148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.243138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e50f2b-feb5-4583-8137-b64ef9f48e1c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.304077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.304077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.304077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.304077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.304599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.304599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.416240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1093/2173] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:27 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:27.417997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.428427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f180d-7723-46ae-811b-a79b3ac9b060 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.433821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854a8-658b-45be-a663-d96a908936db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.434580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854a8-658b-45be-a663-d96a908936db admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.434964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854a8-658b-45be-a663-d96a908936db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.435363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652854a8-658b-45be-a663-d96a908936db admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.436261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652854a8-658b-45be-a663-d96a908936db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.438224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652854a8-658b-45be-a663-d96a908936db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.449883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1081/2174] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:27.454721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.465377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fe357d-e402-4f2a-9660-7a535c90c0f9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.471018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.472223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.472527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.472954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] PATH_INFO: `/v3/projects/5b5f68aa3da8498383604a30a23f8b86/users/9acbb916ed4f43f28f754d6abd379783/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.478951 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:27.488898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f68aa3da8498383604a30a23f8b86, user_id=9acbb916ed4f43f28f754d6abd379783, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.491588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.582340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1094/2175] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:27 2022] PUT /identity/v3/projects/5b5f68aa3da8498383604a30a23f8b86/users/9acbb916ed4f43f28f754d6abd379783/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:27.586337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854a8-658b-45be-a663-d96a908936db admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.596787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652854a8-658b-45be-a663-d96a908936db admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.660259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.661202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.661493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.661773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.662513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.664227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c62f1-027e-42d9-8551-e832f83598fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.674745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1082/2176] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:27.678904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.694518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad6998-3de4-43d7-b98f-6fa873d51040 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.697240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.698341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.698623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.698900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] PATH_INFO: `/v3/projects/5b5f68aa3da8498383604a30a23f8b86/users/9acbb916ed4f43f28f754d6abd379783/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.701725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5f68aa3da8498383604a30a23f8b86, user_id=9acbb916ed4f43f28f754d6abd379783, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.704771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:27.716404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1095/2177] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:27 2022] PUT /identity/v3/projects/5b5f68aa3da8498383604a30a23f8b86/users/9acbb916ed4f43f28f754d6abd379783/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:27.726987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.727466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.727561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.773026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] MFA Rules not processed for user `9acbb916ed4f43f28f754d6abd379783`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:27.774293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:27.856662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1083/2178] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:27.868860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.873575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:27.946790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:27.948279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:27.954795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761108ac-9de0-4b82-bb59-9fbc2292297c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.959273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.960177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.960405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.960686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.961157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c92870-0285-4981-95c9-f86ea0182306 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:27.964979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:27.968727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:27.968727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:27.968727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:27.969236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:27.987830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:27.989367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:28.005697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1096/2179] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:28.062318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:28.064094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:28.073589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1084/2180] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:28.312914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:28.327229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc44b4-d66a-4fdd-8634-057037a77907 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:28.331227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:28.331883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:28.332213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:28.332497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:28.396504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:28.397988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:28.408326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1097/2181] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:29.114607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:29.663331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:29.701672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:29.704945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:29.776213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4f75d-dba6-43cc-b47f-27e3c806c118 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:29.782908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:29.783974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:29.784351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:29.784831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] PATH_INFO: `/v3/users/1e3bbc3f01ec4be2af15e0a7a3ca5f4f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:29.786412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e3bbc3f01ec4be2af15e0a7a3ca5f4f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:29.788502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:29.923682 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:29.932399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6be00-9e0d-4017-b2b4-b63f90754430 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:29.936231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:29.936960 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:29.937313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:29.937681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:29.939619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:30.028381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:30.030528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476c151-3b1f-470c-900c-cbb45d6d929b service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:30.041647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1098/2182] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:30.055589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e3bbc3f01ec4be2af15e0a7a3ca5f4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.069985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e3bbc3f01ec4be2af15e0a7a3ca5f4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.078217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e3bbc3f01ec4be2af15e0a7a3ca5f4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.147178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e3bbc3f01ec4be2af15e0a7a3ca5f4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.147953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e3bbc3f01ec4be2af15e0a7a3ca5f4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.159147 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1085/2183] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:29 2022] DELETE /identity/v3/users/1e3bbc3f01ec4be2af15e0a7a3ca5f4f => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:30.161310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:30.161622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:30.161909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:30.179909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:30.181165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:30.241318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1099/2184] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:30.251788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:30.253502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:30.315342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a0065-293f-4d9c-9e40-f9b6d740abb9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:30.319009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:30.319677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:30.319967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:30.320280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:30.330067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:30.331646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:30.343010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1086/2185] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:30.796937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:30.799417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:30.812438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a201f50-3917-4c9e-aa78-cf00831f3d92 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:30.827765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:30.833152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:30.833459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:30.833734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] PATH_INFO: `/v3/projects/fe4d0919af6444c19f1e20556e19a55a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:30.835038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe4d0919af6444c19f1e20556e19a55a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:30.837009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:30.944654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe4d0919af6444c19f1e20556e19a55a', 'request_id': 'req-abd6709c-bd4b-4c52-aaa7-b019a0619164'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:30.954377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe4d0919af6444c19f1e20556e19a55a', 'request_id': 'req-abd6709c-bd4b-4c52-aaa7-b019a0619164'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.017613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe4d0919af6444c19f1e20556e19a55a', 'request_id': 'req-abd6709c-bd4b-4c52-aaa7-b019a0619164'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.029144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] The token cache is being invalidate because project fe4d0919af6444c19f1e20556e19a55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:31.029439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.030118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.031675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1100/2186] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:30 2022] DELETE /identity/v3/projects/fe4d0919af6444c19f1e20556e19a55a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:31.039133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:31.050572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad97ff4-d77b-4bc7-a35e-a93ad488fdab service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:31.075417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:31.128362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:31.128362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:31.128362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:31.128362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] PATH_INFO: `/v3/users/fe079173784d4aafa967569d8c373f9e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:31.132773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe079173784d4aafa967569d8c373f9e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:31.134785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:31.151458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:31.153098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:31.166520 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6709c-bd4b-4c52-aaa7-b019a0619164 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:31.171659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:31.172576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:31.172865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:31.173140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] PATH_INFO: `/v3/users/ab1e3a3da8284116bd6227953c74f247` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:31.174534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1e3a3da8284116bd6227953c74f247)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:31.176549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:31.340975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe079173784d4aafa967569d8c373f9e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.353396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe079173784d4aafa967569d8c373f9e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.360990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe079173784d4aafa967569d8c373f9e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.389838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1e3a3da8284116bd6227953c74f247'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.402428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1e3a3da8284116bd6227953c74f247'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.409788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1e3a3da8284116bd6227953c74f247'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.484416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe079173784d4aafa967569d8c373f9e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.484979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-948f34ac-ae4c-4df8-94c6-590d090bd9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe079173784d4aafa967569d8c373f9e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.491321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1087/2187] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:31 2022] DELETE /identity/v3/users/fe079173784d4aafa967569d8c373f9e => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:31.512844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:31.572193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1e3a3da8284116bd6227953c74f247'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.572711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1e3a3da8284116bd6227953c74f247'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:31.584840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1101/2188] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:31 2022] DELETE /identity/v3/users/ab1e3a3da8284116bd6227953c74f247 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:31.585545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:31.585908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:31.586188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:31.604983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:31.606331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:31.670088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1088/2189] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:31.679994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:31.681462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:31.743602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fcf6f-cb3a-4830-b9b8-36792e481569 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:31.757925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:31.758491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:31.758879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:31.759046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:31.769665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:31.774078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:31.781702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1102/2190] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:32.062456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:32.170394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:32.172737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:32.192897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa32e4-632f-4ff9-940c-6eaedf5465ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:32.210572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:32.210572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.210572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.210572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] PATH_INFO: `/v3/projects/a6dba2f7d90e4e1a9a398ef7812cb1a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.211612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6dba2f7d90e4e1a9a398ef7812cb1a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:32.213534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:32.337794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6dba2f7d90e4e1a9a398ef7812cb1a2', 'request_id': 'req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.343834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6dba2f7d90e4e1a9a398ef7812cb1a2', 'request_id': 'req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.385025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:32.386889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:32.401965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf3bd39-9650-4a44-9dfd-8579f086f2b5 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:32.422559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6dba2f7d90e4e1a9a398ef7812cb1a2', 'request_id': 'req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.434527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] The token cache is being invalidate because project a6dba2f7d90e4e1a9a398ef7812cb1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:32.434910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.435678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.437944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1089/2191] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:32 2022] DELETE /identity/v3/projects/a6dba2f7d90e4e1a9a398ef7812cb1a2 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:32.441932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:32.443458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:32.463352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:32.464244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.464530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.464807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] PATH_INFO: `/v3/projects/a696b2cf4ea149eb8317efad36bb86d8` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.465971 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a696b2cf4ea149eb8317efad36bb86d8)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:32.469514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:32.509987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cbc3c-1acf-4e83-9e15-b3b9fff667d5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:32.514805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:32.515670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.515953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.516264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] PATH_INFO: `/v3/users/bf6f5d26f8a1403c81b3ad310365afe7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.517478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf6f5d26f8a1403c81b3ad310365afe7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:32.519467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:32.588307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a696b2cf4ea149eb8317efad36bb86d8', 'request_id': 'req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.595703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a696b2cf4ea149eb8317efad36bb86d8', 'request_id': 'req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.668602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a696b2cf4ea149eb8317efad36bb86d8', 'request_id': 'req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.681334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] The token cache is being invalidate because project a696b2cf4ea149eb8317efad36bb86d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:32.681634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.682288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7fbae2c8-792f-4ea3-8f85-c63a8c312f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.684228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1103/2192] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:32 2022] DELETE /identity/v3/projects/a696b2cf4ea149eb8317efad36bb86d8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:32.685163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf6f5d26f8a1403c81b3ad310365afe7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.690408 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a201-4afc-4617-96c6-8c2b47a3afaa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.690587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a201-4afc-4617-96c6-8c2b47a3afaa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.690880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595a201-4afc-4617-96c6-8c2b47a3afaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.698578 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf6f5d26f8a1403c81b3ad310365afe7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.706377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf6f5d26f8a1403c81b3ad310365afe7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.709897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0595a201-4afc-4617-96c6-8c2b47a3afaa None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:32.711135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0595a201-4afc-4617-96c6-8c2b47a3afaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:32.723959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:32.769081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1104/2193] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:32.775198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf6f5d26f8a1403c81b3ad310365afe7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.775861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf6f5d26f8a1403c81b3ad310365afe7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:32.776402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.776693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.778089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.783247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1090/2194] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:32 2022] DELETE /identity/v3/users/bf6f5d26f8a1403c81b3ad310365afe7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:32.800244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:32.801458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:32.869609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1105/2195] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:32.871220 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:32.882866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c258942-f3e4-4e6d-bc7b-6c7ff93fe51f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:32.888430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:32.889206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.889473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.891416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.891416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:32.891416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:32.892977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:32.908188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1091/2196] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:22:32.911239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:32.926452 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ef752-d942-4d81-82ec-4a710d6e85ec None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:32.931295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:32.931963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:32.932290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:32.932574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:32.933292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:32.935209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.070141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1106/2197] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:32 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:33.074258 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.093976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df4ff1-e031-43c5-8be0-891ffbb3dccb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.172882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.173519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.174255 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.174718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.175616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.178408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.262750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1092/2198] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:33.266820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.277201 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002e845-93b8-4beb-91af-412c6faa88e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.282442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.283279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.283565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.283850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.284621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.286589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.297286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1107/2199] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:33.301327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.311288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf913de-4bb2-440e-9ff1-3d0a5bb8769c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.316729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.316729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.316729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.316966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.317729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.319329 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.321152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.323231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.330299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1093/2200] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:33.334325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.347210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d2d44-fb73-41f1-b85b-fedf08b97c62 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.348892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402fc8b8-d456-4014-99c5-eae2266d385c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.352783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.354246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.354829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.354942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.355458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] PATH_INFO: `/v3/projects/f816e128cfa144ea934c591dbe3aeb37/users/f68e69c3e5e34ea884b5ad8339a26b34/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.355796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.356600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.356880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] PATH_INFO: `/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.358613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff47a9ea4064e0680ae6e37abe4def1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.364840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.375732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f816e128cfa144ea934c591dbe3aeb37, user_id=f68e69c3e5e34ea884b5ad8339a26b34, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.378740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35278dce-b5cf-49cb-a168-71ee49f226fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.450249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:33.484859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1094/2201] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:33 2022] PUT /identity/v3/projects/f816e128cfa144ea934c591dbe3aeb37/users/f68e69c3e5e34ea884b5ad8339a26b34/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:33.494770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.495060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.495335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.521310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] MFA Rules not processed for user `f68e69c3e5e34ea884b5ad8339a26b34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:33.522507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.537762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff47a9ea4064e0680ae6e37abe4def1', 'request_id': 'req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:33.543884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff47a9ea4064e0680ae6e37abe4def1', 'request_id': 'req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:33.585790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1095/2202] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:33.597448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.598788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.611465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff47a9ea4064e0680ae6e37abe4def1', 'request_id': 'req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:33.623899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] The token cache is being invalidate because project 9ff47a9ea4064e0680ae6e37abe4def1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:33.624466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:33.625307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cef2d41e-d50d-4869-b2a7-571f0b6f5b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:33.627121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1108/2203] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:33 2022] DELETE /identity/v3/projects/9ff47a9ea4064e0680ae6e37abe4def1 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:33.633970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447467ab-71be-4a37-a49d-69e2f5916e60 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.634261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447467ab-71be-4a37-a49d-69e2f5916e60 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.634543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447467ab-71be-4a37-a49d-69e2f5916e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.653927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-447467ab-71be-4a37-a49d-69e2f5916e60 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:33.655358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-447467ab-71be-4a37-a49d-69e2f5916e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.686509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b3a9c-9fe0-476e-9746-157e893a8254 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.690384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.691030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.691314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.691590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.693434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.705875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.708146 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.717273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1109/2204] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:33.721335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1096/2205] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:33.726948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.727243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.727524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.751648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:33.761216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:33.770869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1110/2206] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:33.776676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.787982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63410d5-53aa-496a-862c-66a1eea5906a service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.792730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.793512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.793804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.794081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.794807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:33.795142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.797214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.811475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1097/2207] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:33.817352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.831086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682af83-4669-40a6-85f1-75e5acc1fd46 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:33.836269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:33.837018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:33.837381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:33.837732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:33.838532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:33.840644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:33.930430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1111/2208] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:33.934488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:33.945591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6409d0-cea2-4791-96d3-d304fee85fed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.007491 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.008083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.008396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.008834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.009800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.011756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:34.123894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1098/2209] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:33 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:34.125040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:34.135040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed777a-2bd0-4aff-b61a-711606ff6e25 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.139590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.140294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.140585 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.140863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.141597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.143250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:34.163128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1112/2210] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:34.167700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:34.179360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2ca75-321d-46c7-8de8-c68db3823553 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.184486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.185178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.185445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.186924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.188168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.190487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe4ca07-9091-4f45-bce9-2eec38bf98de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:34.205624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1099/2211] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:34.206450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:34.218231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293e338-c48b-49da-85d0-2b1109c4e42f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.223400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.224384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.224674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.224954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] PATH_INFO: `/v3/projects/407ff15770684ac198da1ea4843e9171/users/8bbca86bc5944a01bc70057033a8a3fb/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.241236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=407ff15770684ac198da1ea4843e9171, user_id=8bbca86bc5944a01bc70057033a8a3fb, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.243952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:34.269263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:34.344024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1113/2212] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:34 2022] PUT /identity/v3/projects/407ff15770684ac198da1ea4843e9171/users/8bbca86bc5944a01bc70057033a8a3fb/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:34.355436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.355733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.356015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.382748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] MFA Rules not processed for user `8bbca86bc5944a01bc70057033a8a3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:34.383882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:34.450184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1100/2213] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:34.461225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:34.463195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:34.523593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29447ebe-e0c2-4ae1-ab70-1ab004d33c6a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.527272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.527918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.528227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.528510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.539378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.541211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0978bbbf-ee1c-469b-9715-31c28b4a24fb service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:34.551642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1114/2214] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:34.862851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:34.864334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:34.930235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbcb3f6-d720-4305-bec0-16617bd0ff62 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:34.934725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:34.935624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:34.936546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:34.936877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] PATH_INFO: `/v3/users/c62aceafd5574ab896e97ba4c2575313` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:34.938058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62aceafd5574ab896e97ba4c2575313)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:34.940107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:35.193572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62aceafd5574ab896e97ba4c2575313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:35.207757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62aceafd5574ab896e97ba4c2575313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:35.216074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62aceafd5574ab896e97ba4c2575313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:35.306880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62aceafd5574ab896e97ba4c2575313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:35.309044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62aceafd5574ab896e97ba4c2575313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:35.314555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1101/2215] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:34 2022] DELETE /identity/v3/users/c62aceafd5574ab896e97ba4c2575313 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:35.319133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:35.319602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:35.319694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:35.338086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:35.339384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:35.411683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1115/2216] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:35.426078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:35.427764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:35.513032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef71696-e8f3-4cb4-87e2-6a2f1dcd0d55 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:35.522053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:35.522053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:35.522053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:35.522053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:35.536342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:35.537807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b7662-2339-4a94-8b10-6ff800aff17a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:35.549463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1102/2217] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:35.646402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:35.648887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:35.665887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e507f7f6-22ba-48b5-9568-d5002386e6b9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:35.672478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:35.673405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:35.673692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:35.673973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] PATH_INFO: `/v3/users/0e2fdbc97db14b6689f36c3045310bae` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:35.675256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2fdbc97db14b6689f36c3045310bae)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:35.677548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:35.972488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:36.019874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2fdbc97db14b6689f36c3045310bae'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.037128 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2fdbc97db14b6689f36c3045310bae'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.048601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2fdbc97db14b6689f36c3045310bae'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.142327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2fdbc97db14b6689f36c3045310bae'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.142961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2fdbc97db14b6689f36c3045310bae'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.149352 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1116/2218] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:35 2022] DELETE /identity/v3/users/0e2fdbc97db14b6689f36c3045310bae => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:36.153833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:36.154125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:36.155029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:36.173561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:36.174808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:36.184508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:36.186106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:36.261364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1103/2219] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:36.272590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:36.274077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:36.284057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2fa2cc-4ed7-4c0e-ab97-c4a0ee7fc426 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:36.291577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:36.292650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:36.293418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:36.293418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] PATH_INFO: `/v3/projects/96ebf55bd33f4afe85fa18a64fdb9354` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:36.294488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ebf55bd33f4afe85fa18a64fdb9354)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:36.297715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:36.337420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a51f53-b8f6-4e11-a3cd-e6cca46e34d3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:36.340977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:36.341720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:36.342586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:36.342867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:36.353131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:36.355197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:36.366386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1104/2220] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:36.430361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ebf55bd33f4afe85fa18a64fdb9354', 'request_id': 'req-de3e65e0-f987-4fec-a624-2661e1b83054'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.437951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ebf55bd33f4afe85fa18a64fdb9354', 'request_id': 'req-de3e65e0-f987-4fec-a624-2661e1b83054'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.554461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ebf55bd33f4afe85fa18a64fdb9354', 'request_id': 'req-de3e65e0-f987-4fec-a624-2661e1b83054'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.572360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] The token cache is being invalidate because project 96ebf55bd33f4afe85fa18a64fdb9354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:36.572656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.573622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.576103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1117/2221] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:36 2022] DELETE /identity/v3/projects/96ebf55bd33f4afe85fa18a64fdb9354 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:36.582087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:36.590828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9ede4-8463-4eb7-9246-f7edc36dc3ad service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:36.675365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:36.682310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:36.683562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:36.684086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:36.685149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] PATH_INFO: `/v3/users/a5d91aba3c594f0cbc688e4f63fa2756` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:36.687232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d91aba3c594f0cbc688e4f63fa2756)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:36.689962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:36.904077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:36.906033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:36.920811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e65e0-f987-4fec-a624-2661e1b83054 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:36.925540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:36.926482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:36.926832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:36.927177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] PATH_INFO: `/v3/projects/9924b76da2cd4028991ddf5b99a21c1a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:36.928594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9924b76da2cd4028991ddf5b99a21c1a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:36.930599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:36.971985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d91aba3c594f0cbc688e4f63fa2756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.990093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d91aba3c594f0cbc688e4f63fa2756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:36.997796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d91aba3c594f0cbc688e4f63fa2756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.072527 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d91aba3c594f0cbc688e4f63fa2756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.073216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d91aba3c594f0cbc688e4f63fa2756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.079921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1105/2222] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:36 2022] DELETE /identity/v3/users/a5d91aba3c594f0cbc688e4f63fa2756 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:37.095843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9924b76da2cd4028991ddf5b99a21c1a', 'request_id': 'req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.102199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9924b76da2cd4028991ddf5b99a21c1a', 'request_id': 'req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.173530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9924b76da2cd4028991ddf5b99a21c1a', 'request_id': 'req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.202276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] The token cache is being invalidate because project 9924b76da2cd4028991ddf5b99a21c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:37.202570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.203235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.204938 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1118/2223] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:36 2022] DELETE /identity/v3/projects/9924b76da2cd4028991ddf5b99a21c1a => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:37.208883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:37.210259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:37.277232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839855-2118-4682-b1ff-a75d0e3b049c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:37.282684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:37.283651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:37.284105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:37.284573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] PATH_INFO: `/v3/users/9acbb916ed4f43f28f754d6abd379783` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:37.286243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acbb916ed4f43f28f754d6abd379783)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:37.288218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:37.534488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acbb916ed4f43f28f754d6abd379783'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.547628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acbb916ed4f43f28f754d6abd379783'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.559098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acbb916ed4f43f28f754d6abd379783'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.574500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:37.578088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:37.663035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f7ef0-08e0-4ce0-a3a4-fe37491204b5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:37.669161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:37.670709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:37.671071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:37.671627 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] PATH_INFO: `/v3/projects/253b7815afac4bb6990df13fad6ed4cd` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:37.672748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=253b7815afac4bb6990df13fad6ed4cd)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:37.675076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:37.684355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acbb916ed4f43f28f754d6abd379783'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.685427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acbb916ed4f43f28f754d6abd379783'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.693449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1106/2224] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:37 2022] DELETE /identity/v3/users/9acbb916ed4f43f28f754d6abd379783 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:37.807934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '253b7815afac4bb6990df13fad6ed4cd', 'request_id': 'req-c7d7e704-facb-40c8-a000-f721ce1422e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.819056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '253b7815afac4bb6990df13fad6ed4cd', 'request_id': 'req-c7d7e704-facb-40c8-a000-f721ce1422e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.891705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '253b7815afac4bb6990df13fad6ed4cd', 'request_id': 'req-c7d7e704-facb-40c8-a000-f721ce1422e8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.913077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] The token cache is being invalidate because project 253b7815afac4bb6990df13fad6ed4cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:37.913379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.914063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:37.915709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1119/2225] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:37 2022] DELETE /identity/v3/projects/253b7815afac4bb6990df13fad6ed4cd => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:37.924887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:37.924887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:38.014009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198803b-424d-4caa-b917-7461ce68b0e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.073409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.074327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.074616 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.074894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] PATH_INFO: `/v3/users/e52b33a21eee4877825d62cbe6af6f08` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.076088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e52b33a21eee4877825d62cbe6af6f08)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.078121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.167583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:38.169236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:38.188643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e704-facb-40c8-a000-f721ce1422e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.195153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.196043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.196372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.196654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] PATH_INFO: `/v3/projects/5b5f68aa3da8498383604a30a23f8b86` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.198040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5f68aa3da8498383604a30a23f8b86)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.200079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.242249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e52b33a21eee4877825d62cbe6af6f08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.253850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e52b33a21eee4877825d62cbe6af6f08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.260622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e52b33a21eee4877825d62cbe6af6f08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.314944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5f68aa3da8498383604a30a23f8b86', 'request_id': 'req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.322898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5f68aa3da8498383604a30a23f8b86', 'request_id': 'req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.354392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e52b33a21eee4877825d62cbe6af6f08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.354972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee5d36b4-a687-48a6-888e-923ed1b7cd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e52b33a21eee4877825d62cbe6af6f08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.361336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1107/2226] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:22:37 2022] DELETE /identity/v3/users/e52b33a21eee4877825d62cbe6af6f08 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:38.451876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5f68aa3da8498383604a30a23f8b86', 'request_id': 'req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.463264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] The token cache is being invalidate because project 5b5f68aa3da8498383604a30a23f8b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:38.463560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.464234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2de1ff9b-eb33-44ee-8c95-fa586bb5cef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:38.465806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1120/2227] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:38 2022] DELETE /identity/v3/projects/5b5f68aa3da8498383604a30a23f8b86 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:38.471757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.472051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.472397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.489536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:38.490735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:38.549656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1108/2228] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:38.557316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.557784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.558072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.577174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:38.578425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:38.586796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1121/2229] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:38.591398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:38.602994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3f5c-a08e-4f41-853f-ed7883d490d0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.610969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.622659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.628032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1109/2230] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:22:38.633406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:38.656275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb538d-00e4-4b69-a072-bf8798a63811 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.669431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.669431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.669431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.669431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.670001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.670001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.695758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:38.766037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1122/2231] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:38 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:38.770446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:38.781717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:38.782030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb17692-a024-4782-9e77-5a595e135cfe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.849363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:38.850396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.851221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.851387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:38.851495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.851778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.852536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.854646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.870760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f3c130-5fdc-4d1e-8afd-5e3eac9ea765 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:38.881138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:38.882398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:38.882896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:38.883393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] PATH_INFO: `/v3/projects/75d0217238c84e5d86f9443bd607c3ae` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:38.884918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d0217238c84e5d86f9443bd607c3ae)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:38.887223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:38.988108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1110/2232] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:38 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:38.989284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.001178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5bd4ae-786a-4581-935f-b0efa141af4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.007362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.010363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.010363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.010363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.010363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.011195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.023026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1111/2233] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:39.029585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.034470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d0217238c84e5d86f9443bd607c3ae', 'request_id': 'req-bca3d8cf-f427-4bfd-b781-71ba4828c875'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:39.041367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae4c91-29a4-4f57-9ca8-811575198ca6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.042041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d0217238c84e5d86f9443bd607c3ae', 'request_id': 'req-bca3d8cf-f427-4bfd-b781-71ba4828c875'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:39.099862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.100600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.100842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.101200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.101854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.103516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.114253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1112/2234] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:39.118199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.128327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4ce389-4e62-4e09-8c5c-5aabbf4dbad9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.132875 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.133731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.134016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.134291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] PATH_INFO: `/v3/projects/a772610f77b74cd091e2f0aa66762a55/users/8af10c657bd948a095305e1c3f56adc8/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.149166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a772610f77b74cd091e2f0aa66762a55, user_id=8af10c657bd948a095305e1c3f56adc8, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.151817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a3b02-3b6a-4e7e-b54e-455e92ff7111 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.171509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d0217238c84e5d86f9443bd607c3ae', 'request_id': 'req-bca3d8cf-f427-4bfd-b781-71ba4828c875'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:39.182757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] The token cache is being invalidate because project 75d0217238c84e5d86f9443bd607c3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:22:39.183052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:39.183735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-bca3d8cf-f427-4bfd-b781-71ba4828c875 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:22:39.186072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1123/2235] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:22:38 2022] DELETE /identity/v3/projects/75d0217238c84e5d86f9443bd607c3ae => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:39.191436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d31d-a190-4649-ae45-4bb158891e1f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.191734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d31d-a190-4649-ae45-4bb158891e1f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.192310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2d31d-a190-4649-ae45-4bb158891e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.211478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f8a2d31d-a190-4649-ae45-4bb158891e1f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:39.212725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f8a2d31d-a190-4649-ae45-4bb158891e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:39.220856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1124/2236] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:39.228350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.230687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.230687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.247277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:39.249273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:39.258572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1113/2237] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:39 2022] PUT /identity/v3/projects/a772610f77b74cd091e2f0aa66762a55/users/8af10c657bd948a095305e1c3f56adc8/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:39.263910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.264342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.264747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.286392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:39.287623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:39.312462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1125/2238] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:39.317042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.326738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce1a6de-35ed-404f-b7f2-f17cb31e4033 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.331599 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.332305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.332594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.332874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.333624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:22:39.333994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.335603 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.353082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1126/2239] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:22:39.353294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1114/2240] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:22:39.356260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.362442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.365886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:39.367204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d06b4-d693-489d-bd5c-346fc2b3e5fe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.373749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.374184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.374472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.375017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.375722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.377669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.423884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ffb70-3004-4767-9118-77e4c0574cb1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.427579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.428256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.428541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.429069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.438641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.440136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.449822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1115/2241] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:22:39.477181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1127/2242] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/projects => generated 373 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:39.479069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.490268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cf08c1-e97c-49d1-8b6e-53cf3d881f4a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.547828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.548526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.548813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.549088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.549769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.551687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.644880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1116/2243] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:39.649418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.661930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243d4e-cabb-4263-9d1d-543ac6690f00 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.667519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.668821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.668821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.668821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.669501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.671710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.686278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1128/2244] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:39.690343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.700544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ef93f-3fa0-433c-b023-37039ff1b905 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.705218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.705873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.706153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.706426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.707331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.710314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d54691-5b68-40fe-908a-63b06e7a73a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.728188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1117/2245] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:22:39.730402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:39.740872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62437628-a797-4501-804b-ea844f8be5e6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:39.745618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:39.746505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.746789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.747064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] PATH_INFO: `/v3/projects/d9e678a29d004fdc9ff3133e29b58854/users/4280f30d5f48431db44ed2f7b20e07da/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.764164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9e678a29d004fdc9ff3133e29b58854, user_id=4280f30d5f48431db44ed2f7b20e07da, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:39.767773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:39.869075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1129/2246] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:39 2022] PUT /identity/v3/projects/d9e678a29d004fdc9ff3133e29b58854/users/4280f30d5f48431db44ed2f7b20e07da/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:39.874899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6cf8-bc2c-45e2-a002-4549985771df None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:39.875289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6cf8-bc2c-45e2-a002-4549985771df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:39.875691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dc6cf8-bc2c-45e2-a002-4549985771df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:39.894647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b3dc6cf8-bc2c-45e2-a002-4549985771df None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:39.895799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3dc6cf8-bc2c-45e2-a002-4549985771df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:39.955346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1118/2247] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:39.964720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:40.054335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd392f53-3f72-4103-8c00-a9eebf9ab97e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:40.058698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:40.059532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:40.059816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:40.060277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:40.089411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:40.090066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:40.102368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1130/2248] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:40.126614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:40.594764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:40.757105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:40.757232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:40.757484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:40.791252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] MFA Rules not processed for user `8af10c657bd948a095305e1c3f56adc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:40.792703 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:40.861300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1119/2249] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:40.866100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:40.867722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:40.883673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377059c-e5aa-42e9-986d-049420acee72 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:40.890469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:40.891993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:40.891993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:40.891993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:40.892867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:40.894959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.027697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1131/2250] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:22:40 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:41.033654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:41.048554 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789eb15f-4c21-434b-ad0b-c5c8d90c6ff5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:41.111109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:41.111847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.112213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.112500 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.113210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:41.115144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.225867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1120/2251] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:22:41 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:22:41.230248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:41.234414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:41.259035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825aef65-66af-4f1c-b219-d6a8751d9b5d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:41.269555 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:41.270395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.272953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.272953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.272953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:41.274387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.289905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1132/2252] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:41.293935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:41.308078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8f2f61-0256-4dbb-b86f-5e0d7f66be55 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:41.319680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:41.319680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.319680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.319680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] PATH_INFO: `/v3/projects/5498d2b5332e4166bded5ea403476d1b/users/04fa7587b8aa4647b48a2ee000b5de97/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.334696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5498d2b5332e4166bded5ea403476d1b, user_id=04fa7587b8aa4647b48a2ee000b5de97, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:41.337468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.444656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1121/2253] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:41 2022] PUT /identity/v3/projects/5498d2b5332e4166bded5ea403476d1b/users/04fa7587b8aa4647b48a2ee000b5de97/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:22:41.448713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:41.459323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b20d02-23a7-4426-b5b8-262d9dc3a752 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:41.515522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:41.516279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.516574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.516857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.517619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:41.519495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e677a249-bc10-4113-b2f2-0170bff46942 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.531183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1133/2254] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:22:41.535155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:41.553399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c278759-e6a1-4963-ae63-2540ad37a0e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:41.558233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:41.559235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.563083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.563083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] PATH_INFO: `/v3/projects/5498d2b5332e4166bded5ea403476d1b/users/04fa7587b8aa4647b48a2ee000b5de97/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.563083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5498d2b5332e4166bded5ea403476d1b, user_id=04fa7587b8aa4647b48a2ee000b5de97, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:41.565017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:41.577830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1122/2255] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:22:41 2022] PUT /identity/v3/projects/5498d2b5332e4166bded5ea403476d1b/users/04fa7587b8aa4647b48a2ee000b5de97/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:22:41.777520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:41.893833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842b98-718f-4c7a-b59e-a7827e6aaf59 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:41.894698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842b98-718f-4c7a-b59e-a7827e6aaf59 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:41.895030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0842b98-718f-4c7a-b59e-a7827e6aaf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:41.929258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f0842b98-718f-4c7a-b59e-a7827e6aaf59 None None] MFA Rules not processed for user `4280f30d5f48431db44ed2f7b20e07da`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:41.930480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f0842b98-718f-4c7a-b59e-a7827e6aaf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:42.003267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1134/2256] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:42.014756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:42.016478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:42.079949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c434c661-4a8a-472a-907d-fef129eb2080 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:42.084648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:42.085319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:42.085652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:42.086094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:42.095600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:42.097098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67125467-73f0-41f7-a22f-faca78c85d80 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:42.106375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1123/2257] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:42.598596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:43.055347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:43.060004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:43.060004 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:43.099306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] MFA Rules not processed for user `04fa7587b8aa4647b48a2ee000b5de97`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:43.101270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:43.183195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1135/2258] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:43.194435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0714-f11d-458a-886f-fc54873ae919 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:43.194953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0714-f11d-458a-886f-fc54873ae919 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:43.199771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c0714-f11d-458a-886f-fc54873ae919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:43.214805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e59c0714-f11d-458a-886f-fc54873ae919 None None] MFA Rules not processed for user `8af10c657bd948a095305e1c3f56adc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:43.216030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e59c0714-f11d-458a-886f-fc54873ae919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:43.283546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1124/2259] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:43.295696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:22:43.297213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:43.375318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f1c46-bc29-4eae-a56e-2bfa1b973989 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:22:43.381019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:22:43.381681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:43.381973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:43.382257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:43.390926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:22:43.392769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:22:43.402802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1136/2260] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:22:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:22:43.508363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:43.525442 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:43.775882 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.086771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878e70-8bcb-417e-9ad5-7a05a03603bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:22:44.087061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878e70-8bcb-417e-9ad5-7a05a03603bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:22:44.087339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01878e70-8bcb-417e-9ad5-7a05a03603bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:22:44.104637 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01878e70-8bcb-417e-9ad5-7a05a03603bc None None] MFA Rules not processed for user `4280f30d5f48431db44ed2f7b20e07da`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:22:44.105828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01878e70-8bcb-417e-9ad5-7a05a03603bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:22:44.112818 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1125/2261] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:22:44.209649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.398318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.553989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.632255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.712596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.788255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.868413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.954258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:44.983640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.102584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.154708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.176738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.340996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.369762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.457104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.508402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.542851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.611460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.628605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.679713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.749140 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.805800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.823276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.840170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.891471 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.942775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:45.959810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.063231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.091182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.251186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.297083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.445259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.523839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.547054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.643950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.666644 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.794138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.816926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:46.914265 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.022528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.074005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.106905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.199461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.285231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.314884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.417552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.502843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.531233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.559944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.645737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.748424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.777065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.920391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:47.948328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.074166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.106856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.199809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.228558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.325924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.342842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.405563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.457274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.519784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.594643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.679712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.765700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.851459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.908274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:48.986904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:49.015834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:49.141287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:49.226870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:49.319861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:59.113369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=71 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:22:59.359374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=64 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:00.850294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:00.850294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:00.946975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509399a-7112-405e-ba08-2233ae784c98 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:00.956588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:00.957507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:00.957795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:00.958082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] PATH_INFO: `/v3/users/8bbca86bc5944a01bc70057033a8a3fb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:00.959402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbca86bc5944a01bc70057033a8a3fb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:00.962577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:01.225138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbca86bc5944a01bc70057033a8a3fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:01.236789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbca86bc5944a01bc70057033a8a3fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:01.244792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbca86bc5944a01bc70057033a8a3fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:01.354321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbca86bc5944a01bc70057033a8a3fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:01.355349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbca86bc5944a01bc70057033a8a3fb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:01.366309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1137/2262] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:00 2022] DELETE /identity/v3/users/8bbca86bc5944a01bc70057033a8a3fb => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:23:01.367993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:01.368515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:01.368611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:01.387357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:01.388609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:01.472882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1126/2263] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:01.497174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:01.500057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:01.582451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9129afd-0ad6-454c-8d52-55e41e1fcc4f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:01.586246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:01.593188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:01.593486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:01.594175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:01.607896 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:01.610155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d97662-d9ab-4749-a115-de639c88ddb8 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:01.623019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1138/2264] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:23:02.195237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:02.196779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:02.208821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de463053-1340-4cfe-8270-2694d62eb4a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:02.214152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:02.215061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:02.215352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:02.215635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] PATH_INFO: `/v3/projects/407ff15770684ac198da1ea4843e9171` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:02.216912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=407ff15770684ac198da1ea4843e9171)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:02.219371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:02.343534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407ff15770684ac198da1ea4843e9171', 'request_id': 'req-0d659078-031b-4023-b015-dd7367986348'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:02.350396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407ff15770684ac198da1ea4843e9171', 'request_id': 'req-0d659078-031b-4023-b015-dd7367986348'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:02.433465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407ff15770684ac198da1ea4843e9171', 'request_id': 'req-0d659078-031b-4023-b015-dd7367986348'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:02.448002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] The token cache is being invalidate because project 407ff15770684ac198da1ea4843e9171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:02.448397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:02.449195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0d659078-031b-4023-b015-dd7367986348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:02.450929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1127/2265] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:02 2022] DELETE /identity/v3/projects/407ff15770684ac198da1ea4843e9171 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:02.456337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:02.456848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:02.456937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:02.480258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:02.481509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:02.501802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:02.596634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1139/2266] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:02.602821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:02.602821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:02.602821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:02.622902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:02.625588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:02.635583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1128/2267] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:02.640358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:02.657987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dffdf-dedd-4b40-bd8c-42f0e20803ce None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:02.669629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:02.670320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:02.670609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:02.670924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:02.671669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:02.672035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:02.674226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:02.693708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1140/2268] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:02.698251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:02.715907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df657f-7e5c-4ced-86f2-00d108a1c0bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:02.721470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:02.722477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:02.722994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:02.723851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:02.725197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:02.728093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:02.865333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1129/2269] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:02 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:02.869660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:02.884179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcf8d4-219a-4583-9e2c-72088b0309d5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:03.006015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:03.006744 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.006982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.007259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.007999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:03.010074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:03.115103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1141/2270] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:02 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:03.119377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:03.129798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a82c1-bb27-4d6b-8b8c-9a44a0b1d45e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:03.134816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:03.135473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.135766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.136044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.136803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:03.138405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:03.150179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1130/2271] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:03.153717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:03.164774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3631eb-f39f-422e-893a-7dffb11cb276 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:03.169748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:03.173373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.173373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.173373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.173373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:03.174342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fc1ff1-8432-4421-a101-3c1b045d1c3d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:03.189517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1142/2272] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:23:03.190748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:03.200793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c6756-3f32-487f-b332-7ece639d67af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:03.206355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:03.207379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.207674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.207955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] PATH_INFO: `/v3/projects/ea2e6632517846749c11039d1a9e79cd/users/4ab4e3bab8254e4eac1a9e83ff68d8ce/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.225123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2e6632517846749c11039d1a9e79cd, user_id=4ab4e3bab8254e4eac1a9e83ff68d8ce, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:03.228143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:03.346566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1131/2273] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:03 2022] PUT /identity/v3/projects/ea2e6632517846749c11039d1a9e79cd/users/4ab4e3bab8254e4eac1a9e83ff68d8ce/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:23:03.354694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cef70-7ee7-45f4-9000-f9c20fe27d97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.354983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cef70-7ee7-45f4-9000-f9c20fe27d97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.355262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0cef70-7ee7-45f4-9000-f9c20fe27d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.381497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fe0cef70-7ee7-45f4-9000-f9c20fe27d97 None None] MFA Rules not processed for user `4ab4e3bab8254e4eac1a9e83ff68d8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:03.382718 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe0cef70-7ee7-45f4-9000-f9c20fe27d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:03.448248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1143/2274] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:03.459521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:03.462270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:03.499291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:03.550212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b79d3-907b-436a-8367-b8511d8b856c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:03.554461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:03.555131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.555417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.555696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.565139 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:03.568099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e94c0f3-004f-471e-a90b-0bdbee3c1da1 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:03.576754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1132/2275] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:03.864332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:03.864825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:03.865027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:03.883155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] MFA Rules not processed for user `d1e1edac4a2f430ea534bf4911988d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:03.884579 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:03.902495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:03.946395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1144/2276] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:05.388216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c409-e85f-4fc0-9e13-f0981cb92911 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:05.388779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c409-e85f-4fc0-9e13-f0981cb92911 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:05.390169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f65c409-e85f-4fc0-9e13-f0981cb92911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:05.412586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f65c409-e85f-4fc0-9e13-f0981cb92911 None None] MFA Rules not processed for user `4ab4e3bab8254e4eac1a9e83ff68d8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:05.413797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f65c409-e85f-4fc0-9e13-f0981cb92911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:05.421634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1133/2277] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:10.157783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:10.159427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:10.270936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f25646-a413-42c8-a3a4-649dc6589d4c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:10.276200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:10.281301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:10.281301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:10.281301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] PATH_INFO: `/v3/users/f68e69c3e5e34ea884b5ad8339a26b34` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:10.281301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68e69c3e5e34ea884b5ad8339a26b34)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:10.281301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:10.519980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68e69c3e5e34ea884b5ad8339a26b34'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:10.536259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68e69c3e5e34ea884b5ad8339a26b34'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:10.543863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68e69c3e5e34ea884b5ad8339a26b34'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:10.639421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68e69c3e5e34ea884b5ad8339a26b34'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:10.642121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68e69c3e5e34ea884b5ad8339a26b34'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:10.650298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1145/2278] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:10 2022] DELETE /identity/v3/users/f68e69c3e5e34ea884b5ad8339a26b34 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:10.654742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:10.655279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:10.655279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:10.674988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:10.676352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:10.749437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1134/2279] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:10.759293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:10.760916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:10.824931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:10.838138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f813997-9655-4b1a-9a5c-615a69d9a455 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:10.842055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:10.842746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:10.843035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:10.843316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:10.854889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:10.863434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfa99-18b2-4b53-aad3-d132544be056 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:10.876703 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1146/2280] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:11.475176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:11.476658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:11.489352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d7a1b-1f6b-4a74-abe3-59311f5638cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:11.494122 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:11.495020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:11.495306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:11.495585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] PATH_INFO: `/v3/projects/f816e128cfa144ea934c591dbe3aeb37` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:11.496793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f816e128cfa144ea934c591dbe3aeb37)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:11.498850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:11.679588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f816e128cfa144ea934c591dbe3aeb37', 'request_id': 'req-3958fb00-25ed-45a5-ae30-aec950db3f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:11.685713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f816e128cfa144ea934c591dbe3aeb37', 'request_id': 'req-3958fb00-25ed-45a5-ae30-aec950db3f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:11.780901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f816e128cfa144ea934c591dbe3aeb37', 'request_id': 'req-3958fb00-25ed-45a5-ae30-aec950db3f18'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:11.797170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] The token cache is being invalidate because project f816e128cfa144ea934c591dbe3aeb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:11.797605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:11.798850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3958fb00-25ed-45a5-ae30-aec950db3f18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:11.803253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1135/2281] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:11 2022] DELETE /identity/v3/projects/f816e128cfa144ea934c591dbe3aeb37 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:11.806498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:11.807047 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:11.807373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:11.839226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:11.841016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:11.926073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1147/2282] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:11.935700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:11.936684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:11.937223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:11.963812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:11.965410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:11.974723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1136/2283] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:11.979467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:11.990898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848689e-5275-4e18-aefb-5bff1fec1f67 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:11.995959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:11.996628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:11.996909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:11.997185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:11.997932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:11.998231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.001095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.019620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1148/2284] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:12.020898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.032395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58e303-8b1e-4fd6-b1ca-e94b36f858bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.039520 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.040269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.040556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.041320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.045955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.048776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.172786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1137/2285] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:12 2022] POST /identity/v3/projects => generated 389 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:12.173739 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.184366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028443cd-06e7-4bc9-aa84-da5f7743aa4a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.250350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.251129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.251491 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.252219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.252656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.255070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.372024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1149/2286] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:12 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:23:12.374106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.384889 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff7fbd4-7f93-4af5-ac93-14b3610a8089 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.389731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.390404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.390692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.390971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.392164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.393981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.399585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:12.405739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1138/2287] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:12.409884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.421354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee94d5-b862-49f5-8a89-ab9115d7298e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.427476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.428171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.428467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.428751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.429488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.431139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dc572-721e-48d3-9b69-355752e539c7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.441622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1150/2288] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:12.445666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.455721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ed020-ce6a-43e3-9965-d86a12e7dece admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.460315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.461189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.461473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.461751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] PATH_INFO: `/v3/projects/a9829d56d9ce4552b7c6abc9bcfad227/users/8204e84cc7d54048999175b23f6618e1/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.476931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9829d56d9ce4552b7c6abc9bcfad227, user_id=8204e84cc7d54048999175b23f6618e1, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.479549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.547914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1139/2289] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:12 2022] PUT /identity/v3/projects/a9829d56d9ce4552b7c6abc9bcfad227/users/8204e84cc7d54048999175b23f6618e1/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:12.557861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.558151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.558431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.584321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] MFA Rules not processed for user `8204e84cc7d54048999175b23f6618e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:12.585569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:12.625253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:12.649101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1151/2290] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:12.661037 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:12.665677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:12.721407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df360c-5725-4ef5-a969-533a669426c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:12.725054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:12.725693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:12.725976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:12.726251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:12.735227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:12.736635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1000f-427e-4c1c-8d45-0256a55ce28d service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:12.745667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1140/2291] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:18.449391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:18.459167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afd170-00fe-47bb-9dbf-c94fe91b6450 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:18.462870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:18.463560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:18.463831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:18.464174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:18.466034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:18.531431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:18.532932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a636ea5-a2fd-435c-9265-8cb7bffcfbb6 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:18.543218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1152/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:19.860948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d42f-e811-41c0-857e-2af6a4dfa364 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:19.865822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d42f-e811-41c0-857e-2af6a4dfa364 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:19.865822 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d42f-e811-41c0-857e-2af6a4dfa364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:19.890082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0a22d42f-e811-41c0-857e-2af6a4dfa364 None None] MFA Rules not processed for user `4280f30d5f48431db44ed2f7b20e07da`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:19.892630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a22d42f-e811-41c0-857e-2af6a4dfa364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:20.019266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1141/2293] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:21.399840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:21.400429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:21.400645 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:21.439156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:21.440306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:21.440423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:21.440593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:21.441621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:21.478529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:21.479969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:21.604808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1153/2294] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:23:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:21.610933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1142/2295] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:21.643752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:21.648446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:21.693487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:21.695698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:21.736321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:21.793106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aae3b0-58df-48d3-94ad-0be2dc3f86c2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:21.804879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:21.805524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:21.806224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:21.806529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:21.823209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:21.830273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:21.834964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd8eb6-9078-485c-81a2-ac256b0e96d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:21.840872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:21.841776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:21.842215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:21.842644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:21.852133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1154/2296] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:21.854537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:21.857192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f11df-c088-4082-b234-08742f4c0153 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:21.867656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1143/2297] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:23:25.716066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:25.730490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:25.735847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34d2e7-3aea-4546-a3e2-3a79072c167a service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:25.745698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:25.746863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:25.747307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:25.747732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] PATH_INFO: `/v3/users/8204e84cc7d54048999175b23f6618e1` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:25.752723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8204e84cc7d54048999175b23f6618e1)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:25.755716 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:26.003000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8204e84cc7d54048999175b23f6618e1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:26.038443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8204e84cc7d54048999175b23f6618e1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:26.055347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8204e84cc7d54048999175b23f6618e1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:26.169692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8204e84cc7d54048999175b23f6618e1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:26.169692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8204e84cc7d54048999175b23f6618e1'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:26.184814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1155/2298] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:25 2022] DELETE /identity/v3/users/8204e84cc7d54048999175b23f6618e1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:26.188801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:26.189345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:26.189513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:26.264382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:26.266463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:26.423528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1144/2299] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:26.438310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:26.440340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:26.551397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58994da5-715c-4d21-81b9-fdbc0ca6014b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:26.566905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:26.568060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:26.574535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:26.574535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:26.586426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:26.587972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00826f-c89d-46d8-837a-17165a9d9418 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:26.599991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1156/2300] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:27.244757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:27.249080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:27.272130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596f4b7-1dcc-4445-ab64-517ba87dfbd2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:27.280741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:27.281686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:27.281949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:27.282230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] PATH_INFO: `/v3/projects/a9829d56d9ce4552b7c6abc9bcfad227` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:27.284813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9829d56d9ce4552b7c6abc9bcfad227)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:27.287092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:27.475307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9829d56d9ce4552b7c6abc9bcfad227', 'request_id': 'req-82f635bf-1ffa-4854-b504-dd838b414e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:27.483891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9829d56d9ce4552b7c6abc9bcfad227', 'request_id': 'req-82f635bf-1ffa-4854-b504-dd838b414e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:27.569721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9829d56d9ce4552b7c6abc9bcfad227', 'request_id': 'req-82f635bf-1ffa-4854-b504-dd838b414e1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:27.592828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] The token cache is being invalidate because project a9829d56d9ce4552b7c6abc9bcfad227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:27.594237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:27.595008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-82f635bf-1ffa-4854-b504-dd838b414e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:27.600905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1145/2301] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:27 2022] DELETE /identity/v3/projects/a9829d56d9ce4552b7c6abc9bcfad227 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:27.602133 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:27.602999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:27.603446 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:27.662662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:27.667340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:27.822483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1157/2302] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:27.831748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:27.832040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:27.832357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:27.852317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:27.854243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:27.862893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1146/2303] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:27.867460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:27.878257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fef16d-a5a6-4519-a452-a8ea03c7f5b5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:27.884225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:27.885029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:27.885423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:27.885819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:27.886837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:27.887246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:27.889275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:27.911294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1158/2304] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:27.915977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:27.927153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d253c698-62e0-4e9c-9ec3-3b722fdce42a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:27.935816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:27.939987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:27.939987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:27.939987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:27.939987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:27.939987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:28.075592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1147/2305] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:27 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:28.079952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:28.094914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc6208-279c-439d-adcf-013f27cbfd2c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:28.107634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:28.273239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:28.274046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:28.274403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:28.274822 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:28.275880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:28.293499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:28.461017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1159/2306] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:28 2022] POST /identity/v3/users => generated 287 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:28.462019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:28.498005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f3c41-8106-4476-9ce1-5e3ec80d0b63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:28.528611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:28.529219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:28.529525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:28.529794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:28.535179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:28.536885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:28.566178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:28.583705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1148/2307] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:23:28.587711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:28.601639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba5f09-0aae-4722-adcd-3d53cc3e8ec1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:28.614129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:28.614129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:28.615058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:28.615058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:28.615563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:28.618192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3817f0-e99a-4ff2-a4d7-e72b578610bc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:28.636351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1160/2308] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:28 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:28.645724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:28.651730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393d673-671c-46f6-981e-6c96c8fb63d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:28.659546 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:28.661434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:28.661978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:28.662461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] PATH_INFO: `/v3/projects/a6ddd799b01349669cf6dadc85008078/users/93f5a80ad4564329aa4f075f3e18ce97/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:28.697463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6ddd799b01349669cf6dadc85008078, user_id=93f5a80ad4564329aa4f075f3e18ce97, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:28.706429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:28.849316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1149/2309] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:28 2022] PUT /identity/v3/projects/a6ddd799b01349669cf6dadc85008078/users/93f5a80ad4564329aa4f075f3e18ce97/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:28.851712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c32-fb59-4791-9dc8-2803063655db None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:28.852551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c32-fb59-4791-9dc8-2803063655db None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:28.853046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc31c32-fb59-4791-9dc8-2803063655db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:28.912243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5fc31c32-fb59-4791-9dc8-2803063655db None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:28.914788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5fc31c32-fb59-4791-9dc8-2803063655db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:28.993411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1161/2310] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:29.007735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:29.009975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:29.098534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd063cdf-9c21-4e5f-ac11-de32acc52bb3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:29.103344 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:29.103996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:29.104351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:29.104640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:29.116671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:29.118921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:29.132619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1150/2311] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:29.272019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566f8-b7e9-40fb-89ff-2fb97fff996e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:29.272394 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566f8-b7e9-40fb-89ff-2fb97fff996e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:29.272617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff566f8-b7e9-40fb-89ff-2fb97fff996e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:29.301020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fff566f8-b7e9-40fb-89ff-2fb97fff996e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:29.303034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fff566f8-b7e9-40fb-89ff-2fb97fff996e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:29.312562 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1162/2312] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:29.334823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:29.336346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:29.484293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80893659-977c-4ef9-ba6d-449a4e5192a1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:29.492379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:29.493306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:29.493756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:29.494188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:29.504608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:29.506481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc5535-9d40-4432-9b73-216fe6e7526d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:29.519914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1151/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:33.709378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:33.710975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:33.711801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:33.744010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] MFA Rules not processed for user `c39a7058d0e1423f8d8464eb4c09e490`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:33.746180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:33.889650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1163/2314] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:35.096639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccbf64-e9cb-423b-a82a-3f49b227dbcc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:35.100302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccbf64-e9cb-423b-a82a-3f49b227dbcc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:35.100302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccbf64-e9cb-423b-a82a-3f49b227dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:35.146989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4eccbf64-e9cb-423b-a82a-3f49b227dbcc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:35.148744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4eccbf64-e9cb-423b-a82a-3f49b227dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:35.161721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1152/2315] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:35.812706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:35.817360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:35.852471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee55d-5f59-4495-a6cd-fca287c04977 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:35.859189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:35.860611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:35.861125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:35.861633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:35.871552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:35.873356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:35.901861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1164/2316] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:40.874321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2842c-a4ae-481a-88bc-82f30663089f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:40.874904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2842c-a4ae-481a-88bc-82f30663089f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:40.874904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee2842c-a4ae-481a-88bc-82f30663089f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:40.913035 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bee2842c-a4ae-481a-88bc-82f30663089f None None] MFA Rules not processed for user `93f5a80ad4564329aa4f075f3e18ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:40.915612 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bee2842c-a4ae-481a-88bc-82f30663089f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:41.036143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:41.071301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1153/2317] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:41.072594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.144158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098787d3-c63d-44e7-a9e1-87736f77d99c service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.157042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.157811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.158172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.158521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.160539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.166843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.185436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:41.189386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.189806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.190186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.245211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:41.246521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:41.259853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1154/2318] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:41.288256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.300747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507835f1-eef4-4dac-b574-cf7c99f72540 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.307025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.316666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.316666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.316666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.328283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1165/2319] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:41.333023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.346210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.347942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4d59e-0fab-4009-b289-26f18e80ba73 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.372193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1155/2320] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:41.375575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.376362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.377010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.408501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:41.410378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:41.501925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1156/2321] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:23:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:41.516808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.521011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:41.523355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151e1d3-ea33-444d-9522-37ed51e826e8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.537400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.545576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.545576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.545576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.545576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.545576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.611759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128d6b6-9847-45cd-8a05-06847577eba0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.620387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.621253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.621534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.621950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.633510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.635358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.645536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1157/2322] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:23:41.660614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1166/2323] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:41 2022] POST /identity/v3/users => generated 293 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:41.664990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.679045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1acdca8-ec4c-49a6-aa2e-ada31ef8dc10 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.684362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.685089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.685439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.685781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.687163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.688798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.699151 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1158/2324] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:23:41.704106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.714116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a38fe-d10f-435c-8f2b-57b37258094b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.719107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.726083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.726083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.726083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] PATH_INFO: `/v3/projects/3dadbc8c2c8747978e17f060b598c326/users/0967c98f75b745f38094d56c77041eaf/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.735301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dadbc8c2c8747978e17f060b598c326, user_id=0967c98f75b745f38094d56c77041eaf, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.738098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.829160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1167/2325] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:41 2022] PUT /identity/v3/projects/3dadbc8c2c8747978e17f060b598c326/users/0967c98f75b745f38094d56c77041eaf/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:23:41.833565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.844897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe79271-ace9-4030-81e7-292a52d9a61e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.927929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.928650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.929206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.929497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.930246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.932042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7d4e3-9e01-4989-ba1c-b471d127bf7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.947643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1159/2326] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:41.949061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:41.960277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58226a29-cff3-4892-80c1-616c11bc9d5f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:41.964994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:41.966093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:41.966382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:41.966664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] PATH_INFO: `/v3/projects/3dadbc8c2c8747978e17f060b598c326/users/0967c98f75b745f38094d56c77041eaf/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:41.968976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dadbc8c2c8747978e17f060b598c326, user_id=0967c98f75b745f38094d56c77041eaf, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:41.971657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:41.987046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1168/2327] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:41 2022] PUT /identity/v3/projects/3dadbc8c2c8747978e17f060b598c326/users/0967c98f75b745f38094d56c77041eaf/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:42.517249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:42.989728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cc74a-e8e5-451d-805d-77ee072dd48c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:42.990950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cc74a-e8e5-451d-805d-77ee072dd48c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:42.991523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627cc74a-e8e5-451d-805d-77ee072dd48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:43.016234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-627cc74a-e8e5-451d-805d-77ee072dd48c None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:43.019682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-627cc74a-e8e5-451d-805d-77ee072dd48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:43.198685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1160/2328] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:43.214421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:43.352464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2b850-47ec-450a-9432-ce06bacfedf2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:43.370298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:43.371024 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:43.371311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:43.371589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:43.395443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:43.399760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:43.415265 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1169/2329] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:23:44.270287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1e9e-0b75-4edd-a50a-b20b57425a01 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:44.270765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1e9e-0b75-4edd-a50a-b20b57425a01 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:44.270915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e1e9e-0b75-4edd-a50a-b20b57425a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:44.311790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d5e1e9e-0b75-4edd-a50a-b20b57425a01 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:44.313087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d5e1e9e-0b75-4edd-a50a-b20b57425a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:44.334411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1161/2330] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:23:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:44.371356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:44.395873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a74ca65-302d-4995-b6fe-f0a7cb70a21d service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:44.413591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:44.415979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:44.415979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:44.415979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:44.433755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:44.435387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:44.453805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1170/2331] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:23:45.550430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1ec0-629c-4f7f-9b2b-5d33f5fbfa02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:45.557635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1ec0-629c-4f7f-9b2b-5d33f5fbfa02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:45.557635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f1ec0-629c-4f7f-9b2b-5d33f5fbfa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:45.578462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc4f1ec0-629c-4f7f-9b2b-5d33f5fbfa02 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:45.579924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc4f1ec0-629c-4f7f-9b2b-5d33f5fbfa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:45.601839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1162/2332] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:23:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:45.613865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:45.629999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793d10ef-2982-492c-be46-0ff02b594435 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:45.645056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:45.646065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:45.646592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:45.649959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:45.669339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:45.673748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31720c6d-9c67-4d32-b64a-c5250dc894d5 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:45.732092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1171/2333] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:23:45.807285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:45.808235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:45.808530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:45.809989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1163/2334] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:23:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:45.833409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a017-a9bd-45c7-b4c2-546d2cae313f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:45.833911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a017-a9bd-45c7-b4c2-546d2cae313f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:45.834341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5a017-a9bd-45c7-b4c2-546d2cae313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:45.857891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:45.891182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dac5a017-a9bd-45c7-b4c2-546d2cae313f None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:45.892868 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dac5a017-a9bd-45c7-b4c2-546d2cae313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:46.052368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1172/2335] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:23:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:46.065693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:46.068381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:46.177656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe3ada-a596-43c4-af04-35220e5857b9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:46.190841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:46.191945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:46.196416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:46.196416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:46.247424 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:46.250311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e7f1c-3200-4585-b3fb-951437297bd3 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:46.291379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1164/2336] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:46.586786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:46.587180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:46.588333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:46.589222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1173/2337] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:46.598970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b368b5-1058-4421-8cf8-4c794846b597 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:46.599478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b368b5-1058-4421-8cf8-4c794846b597 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:46.599659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b368b5-1058-4421-8cf8-4c794846b597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:46.628070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b1b368b5-1058-4421-8cf8-4c794846b597 None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:46.629591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1b368b5-1058-4421-8cf8-4c794846b597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:46.713508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1165/2338] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:46.730883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:46.738537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:46.755653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d6bdd-c5a8-4f32-b4c3-04b06885fc8e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:46.763204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:46.764401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:46.764687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:46.765163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:46.775249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:46.777117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228b0cd-3eeb-4c50-8470-ceca129a251f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:46.788678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1174/2339] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:46.792422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac02e9-e555-4fa3-938a-cd540d3999c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:46.793041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac02e9-e555-4fa3-938a-cd540d3999c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:46.793503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac02e9-e555-4fa3-938a-cd540d3999c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:46.833454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52ac02e9-e555-4fa3-938a-cd540d3999c2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:46.835225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52ac02e9-e555-4fa3-938a-cd540d3999c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:46.907522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:47.009121 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1166/2340] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:47.020076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1016-019a-4187-bdaf-0c8d1fed04b2 None None] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:47.020402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1016-019a-4187-bdaf-0c8d1fed04b2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:47.020683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d1016-019a-4187-bdaf-0c8d1fed04b2 None None] PATH_INFO: `/` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:47.022284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1175/2341] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:23:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:47.035798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:47.036664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:47.036953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:47.042478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d1016-019a-4187-bdaf-0c8d1fed04b2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:47.063017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d1016-019a-4187-bdaf-0c8d1fed04b2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:47.073812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:47.075948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:47.076884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:47.077549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:47.077839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:47.078287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:47.092664 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:47.094244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:47.100483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1167/2342] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:47.114752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1176/2343] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:23:47.124402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:47.137046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfef9e7-a42a-454a-9f17-e9e919c1fde7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:47.141244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:47.142325 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:47.142429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:47.143074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:47.155967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:47.157866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334a2431-5b25-488c-8db5-6ee130894bad service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:47.192659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1168/2344] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:49.735071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:49.737353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:49.755109 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903caf6-0101-42e3-8135-650a6d3e1b94 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:49.764749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:49.768260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:49.769922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:49.770875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] PATH_INFO: `/v3/users/4ab4e3bab8254e4eac1a9e83ff68d8ce` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:49.772792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab4e3bab8254e4eac1a9e83ff68d8ce)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:49.775662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:50.005928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab4e3bab8254e4eac1a9e83ff68d8ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:50.031309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab4e3bab8254e4eac1a9e83ff68d8ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:50.059648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab4e3bab8254e4eac1a9e83ff68d8ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:50.134669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab4e3bab8254e4eac1a9e83ff68d8ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:50.134669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab4e3bab8254e4eac1a9e83ff68d8ce'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:50.145083 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1177/2345] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:49 2022] DELETE /identity/v3/users/4ab4e3bab8254e4eac1a9e83ff68d8ce => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:50.146920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3b9-e263-4843-8b90-052e1ab967d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.147379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3b9-e263-4843-8b90-052e1ab967d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.147656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3b9-e263-4843-8b90-052e1ab967d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.171834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5eadf3b9-e263-4843-8b90-052e1ab967d4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:50.173186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5eadf3b9-e263-4843-8b90-052e1ab967d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.276962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1169/2346] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:50.324101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:50.325592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.405530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1adb-9662-4f68-8bcc-a4f62e814d94 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.405830 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1adb-9662-4f68-8bcc-a4f62e814d94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.406114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a1adb-9662-4f68-8bcc-a4f62e814d94 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.408054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1170/2347] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:23:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:23:50.460977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:50.464188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.464497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.464775 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.494514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65003ff-e642-4625-a465-6abb788df303 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:50.499583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:50.500296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.500602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.504438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.507701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] MFA Rules not processed for user `6bf6579be6b84cefb9bafe082cfa19f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:50.509331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.538220 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:50.539693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:50.554145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1178/2348] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:50.660476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1171/2349] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:23:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:50.698650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:50.700170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:50.728479 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1666a-cc05-4a5f-85f7-a14dfabd403e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:50.760454 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:50.767195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:50.767195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:50.767195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:50.777014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:50.780865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f3720d-b7ea-458d-a363-90a1016a77a7 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:50.799188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1179/2350] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:51.353668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.355180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.397802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868aa87-2274-4287-a0f1-a18190c7cbf4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:51.419582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:51.420999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.422456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.422456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] PATH_INFO: `/v3/projects/ea2e6632517846749c11039d1a9e79cd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.427720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2e6632517846749c11039d1a9e79cd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:51.430976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:51.555900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937110-5409-42f6-951d-09e833fd8793 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:51.561204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937110-5409-42f6-951d-09e833fd8793 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:51.561204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937110-5409-42f6-951d-09e833fd8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:51.608572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-20937110-5409-42f6-951d-09e833fd8793 None None] MFA Rules not processed for user `0967c98f75b745f38094d56c77041eaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:51.610190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20937110-5409-42f6-951d-09e833fd8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:51.659153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:51.677686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2e6632517846749c11039d1a9e79cd', 'request_id': 'req-21df108c-454c-4920-801b-cefa24370d77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:51.688110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2e6632517846749c11039d1a9e79cd', 'request_id': 'req-21df108c-454c-4920-801b-cefa24370d77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:51.775960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2e6632517846749c11039d1a9e79cd', 'request_id': 'req-21df108c-454c-4920-801b-cefa24370d77'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:51.788445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1180/2351] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:51 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:51.801190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] The token cache is being invalidate because project ea2e6632517846749c11039d1a9e79cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:51.801495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:51.802494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:51.812634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1172/2352] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:51 2022] DELETE /identity/v3/projects/ea2e6632517846749c11039d1a9e79cd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:51.922170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937110-5409-42f6-951d-09e833fd8793 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:51.923914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20937110-5409-42f6-951d-09e833fd8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.051359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937110-5409-42f6-951d-09e833fd8793 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.169717 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.170969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.171257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.171631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.173403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.247069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:52.248611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.281440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:52.284092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56bf03-ebb3-4ea0-9388-d5f164f4bbf7 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:52.317878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1181/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:52.322721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.322721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.322721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.357121 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:52.359091 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.364142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df108c-454c-4920-801b-cefa24370d77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.372360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.377461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:52.385751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.385751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.385751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] PATH_INFO: `/v3/users/8af10c657bd948a095305e1c3f56adc8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.385751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8af10c657bd948a095305e1c3f56adc8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:52.386344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1182/2354] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:52.388360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:52.533838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:52.535961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:52.559573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55afd29d-f6d8-4c77-963d-0e15b0b7d06a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:52.577246 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:52.578242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:52.578690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:52.579125 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:52.604735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:52.606787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:52.637778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1183/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:52.681878 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8af10c657bd948a095305e1c3f56adc8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.706566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8af10c657bd948a095305e1c3f56adc8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.719635 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8af10c657bd948a095305e1c3f56adc8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.820836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8af10c657bd948a095305e1c3f56adc8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.821484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8af10c657bd948a095305e1c3f56adc8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:52.828723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1173/2356] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:52 2022] DELETE /identity/v3/users/8af10c657bd948a095305e1c3f56adc8 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:23:53.174216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:53.184254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a816f-bbd4-4337-be20-3599d5f49fce service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:53.259647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:53.260595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:53.260883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:53.261193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] PATH_INFO: `/v3/projects/a772610f77b74cd091e2f0aa66762a55` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:53.262730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a772610f77b74cd091e2f0aa66762a55)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:53.264725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:53.408964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a772610f77b74cd091e2f0aa66762a55', 'request_id': 'req-6afd9759-1e35-4d77-b181-149bbb8e6093'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.417821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a772610f77b74cd091e2f0aa66762a55', 'request_id': 'req-6afd9759-1e35-4d77-b181-149bbb8e6093'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.596030 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a772610f77b74cd091e2f0aa66762a55', 'request_id': 'req-6afd9759-1e35-4d77-b181-149bbb8e6093'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.609529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] The token cache is being invalidate because project a772610f77b74cd091e2f0aa66762a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:53.609824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.610483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.614952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1184/2357] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:53 2022] DELETE /identity/v3/projects/a772610f77b74cd091e2f0aa66762a55 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:53.616164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:53.619081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:53.635804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379b978-0f41-4558-b6fa-afa7c1c5bc4e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:53.706449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:53.722603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:53.723589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:53.723872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:53.724185 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] PATH_INFO: `/v3/users/04fa7587b8aa4647b48a2ee000b5de97` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:53.725398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fa7587b8aa4647b48a2ee000b5de97)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:53.727321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:53.914473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fa7587b8aa4647b48a2ee000b5de97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.927322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fa7587b8aa4647b48a2ee000b5de97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:53.934005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fa7587b8aa4647b48a2ee000b5de97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.015698 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fa7587b8aa4647b48a2ee000b5de97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.016456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8e435c12-209f-426c-b867-1ec6154afe3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fa7587b8aa4647b48a2ee000b5de97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.024093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1174/2358] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:53 2022] DELETE /identity/v3/users/04fa7587b8aa4647b48a2ee000b5de97 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:54.392759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:54.394244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:54.403213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:54.414356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd9759-1e35-4d77-b181-149bbb8e6093 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:54.587867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:54.590444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:54.590743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:54.591193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] PATH_INFO: `/v3/projects/5498d2b5332e4166bded5ea403476d1b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:54.592548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5498d2b5332e4166bded5ea403476d1b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:54.594578 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:54.716516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5498d2b5332e4166bded5ea403476d1b', 'request_id': 'req-80f89cdf-229f-4c5a-8814-facab897ce84'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.729141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5498d2b5332e4166bded5ea403476d1b', 'request_id': 'req-80f89cdf-229f-4c5a-8814-facab897ce84'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.838988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5498d2b5332e4166bded5ea403476d1b', 'request_id': 'req-80f89cdf-229f-4c5a-8814-facab897ce84'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.854363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] The token cache is being invalidate because project 5498d2b5332e4166bded5ea403476d1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:54.854752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.856339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-80f89cdf-229f-4c5a-8814-facab897ce84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:54.868483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1185/2359] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:54 2022] DELETE /identity/v3/projects/5498d2b5332e4166bded5ea403476d1b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:54.874216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:54.875053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:54.875506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:54.900421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:54.900421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:54.979700 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1175/2360] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:54.989235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:54.989892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:54.990501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.013012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:55.015416 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:55.027433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1186/2361] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:55.031837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.052773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86906e7-8001-4760-86b5-e44f7977c89c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.061809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.063593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.064110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.064621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.065828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:55.066629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.068714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.095306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1176/2362] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:55.099672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.111950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80492a7f-b2bc-456d-83d9-2279047779db None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.118954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.123790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.123790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.123790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.124267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.126959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.258381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1187/2363] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:55 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:23:55.262342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.275387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535329d8-b99d-4cf8-b675-a6a76bf3e0e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.358658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.359396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.359692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.359975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.367675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.367675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.490656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1177/2364] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:55 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:55.494465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.505583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef0e1fe-d00f-46a9-a169-051bd28625c6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.510630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.513237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.514089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.514374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.515655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.517447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.533827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1188/2365] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:55.538047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.548953 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276189b-a1b1-4b30-b386-9678c197f8b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.553945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.555941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.555941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.555941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.555941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.557540 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cffb26-30e5-401f-9919-f70e6be35695 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.569798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1178/2366] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:23:55.581155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:55.602690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65653203-237c-44df-9c35-42fbea1c60f0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:55.612830 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:55.615953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.616487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.618652 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] PATH_INFO: `/v3/projects/448e5e94380b4fbcbb106c4eebe9c942/users/558ffba0d7e040b698c00e34b9c6d94c/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.645888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e5e94380b4fbcbb106c4eebe9c942, user_id=558ffba0d7e040b698c00e34b9c6d94c, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:55.651735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a31bd-d397-44da-8104-61d1b4e3f1fa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:55.772191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1189/2367] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:23:55 2022] PUT /identity/v3/projects/448e5e94380b4fbcbb106c4eebe9c942/users/558ffba0d7e040b698c00e34b9c6d94c/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:55.782937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.783301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.784191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.880872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] MFA Rules not processed for user `558ffba0d7e040b698c00e34b9c6d94c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:55.882126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:55.896091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:55.902816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:55.902816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:55.902816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:55.929919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] MFA Rules not processed for user `93f5a80ad4564329aa4f075f3e18ce97`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:55.941008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:55.996395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1179/2368] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:56.008240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:56.010536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:56.025014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1190/2369] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:23:56.132257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa5b89-7438-4006-a339-39e83bb2349d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:56.141028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:56.143872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:56.144615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:56.155246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:56.184487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:56.187675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fb3f71-e8fb-43c8-9bae-d48b414ee642 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:56.215630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1180/2370] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:56 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:56.222857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:56.226082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:56.226370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:56.226647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:56.233144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:56.259645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:56.260892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:56.346018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1181/2371] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:23:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:56.361156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:56.363711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:56.375817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3360bc24-ae92-43f6-816d-82b1b429ecac None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:56.387692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:56.388809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:56.389090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:56.389369 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] PATH_INFO: `/v3/users/558ffba0d7e040b698c00e34b9c6d94c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:56.391424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=558ffba0d7e040b698c00e34b9c6d94c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:56.393574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:56.497326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d8456-ec91-4a08-aa4e-06aa14fb7cfe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:56.503521 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:56.504262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:56.504561 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:56.504833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:56.515989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:56.515989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635a454-68d6-45b6-a136-80bb4312495c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:56.524914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1182/2372] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:23:56.718784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '558ffba0d7e040b698c00e34b9c6d94c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:56.773015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '558ffba0d7e040b698c00e34b9c6d94c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:56.795953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '558ffba0d7e040b698c00e34b9c6d94c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:56.860087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '558ffba0d7e040b698c00e34b9c6d94c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:56.861149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '558ffba0d7e040b698c00e34b9c6d94c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:56.870078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1191/2373] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:23:56 2022] DELETE /identity/v3/users/558ffba0d7e040b698c00e34b9c6d94c => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:56.875057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:56.875404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:56.875743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:56.906853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:56.908444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:57.081437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1183/2374] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:57.095204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:57.096528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:57.242015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809620a2-b0ee-4c9c-8969-cb35d5f4b4c5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:57.247628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:57.248348 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:57.248637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:57.251405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:57.281874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:57.283344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ed7d6-32e1-40fd-8e39-e978d17a37c4 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:57.303887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1192/2375] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:23:57.690994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:58.331894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:58.658259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:58.660656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:58.677947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e188b66-d4e9-49a1-9e5b-fefca8553464 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:58.684835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:58.693603 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:58.694426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:58.695340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] PATH_INFO: `/v3/projects/448e5e94380b4fbcbb106c4eebe9c942` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:58.697161 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=448e5e94380b4fbcbb106c4eebe9c942)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:58.699510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:58.844782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448e5e94380b4fbcbb106c4eebe9c942', 'request_id': 'req-5e22efaa-9763-49d4-87dc-0c1c805715eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:58.852367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448e5e94380b4fbcbb106c4eebe9c942', 'request_id': 'req-5e22efaa-9763-49d4-87dc-0c1c805715eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:58.928584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448e5e94380b4fbcbb106c4eebe9c942', 'request_id': 'req-5e22efaa-9763-49d4-87dc-0c1c805715eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:58.943303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] The token cache is being invalidate because project 448e5e94380b4fbcbb106c4eebe9c942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:23:58.943847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:58.944689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5e22efaa-9763-49d4-87dc-0c1c805715eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:23:58.948363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1184/2376] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:23:58 2022] DELETE /identity/v3/projects/448e5e94380b4fbcbb106c4eebe9c942 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:23:58.953870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:58.954163 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:58.954789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:58.988071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:58.989867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:59.077415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1193/2377] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:59.078118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:59.078451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:59.081397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:59.114526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:23:59.115872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:23:59.125138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1185/2378] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:23:59.140930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:59.156058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601171cc-ba43-468c-8c3c-4c5fe5f7258b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:59.163656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:59.167916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:59.185225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1194/2379] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:23:59.190811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:59.201837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776c3f8-40b8-461a-8a7f-1af463bb47d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:59.207422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:59.211044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:59.211044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:59.211044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:59.211044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:23:59.212459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:23:59.244792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:23:59.908231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1186/2380] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:23:59 2022] POST /identity/v3/projects => generated 361 bytes in 717 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:23:59.911129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:23:59.922439 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8eea4-e28f-4db5-bce9-d0ad4a2c6668 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:23:59.995880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:23:59.996842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:23:59.997191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:23:59.997415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:23:59.998705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.001110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.099284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1195/2381] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:23:59 2022] POST /identity/v3/users => generated 281 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:24:00.100550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:00.112573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6057ef24-5d02-40ff-b633-adfad8a2ee1d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:00.117601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:00.123293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.123293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.123293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.123293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.123293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.134934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1187/2382] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:24:00.140194 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:00.152377 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7583011d-ba37-46cc-8e92-8f966145f590 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:00.160659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:00.161477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.161901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.162327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.163116 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.165176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74d2b4-350c-4cbc-9069-ad593205a53b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.192147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1196/2383] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:24:00.195194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:00.212559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe06837-0b68-4be5-9c94-4ef9de1a6a11 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:00.226514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:00.227430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.227720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.228010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] PATH_INFO: `/v3/projects/4dfd0d1500b1482fbe84e98665a83158/users/405901951a6c436db2ae76ffb5b30234/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.256247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfd0d1500b1482fbe84e98665a83158, user_id=405901951a6c436db2ae76ffb5b30234, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.260152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.410544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1188/2384] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:24:00 2022] PUT /identity/v3/projects/4dfd0d1500b1482fbe84e98665a83158/users/405901951a6c436db2ae76ffb5b30234/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:00.424826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.425100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.425382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.469262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] MFA Rules not processed for user `405901951a6c436db2ae76ffb5b30234`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:00.470545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:00.555282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:00.581085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1197/2385] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:00.617167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:00.619274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:00.682916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3286b8-b587-4ca5-80c3-54cea9dcf05f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:00.686899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:00.687574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.687856 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.688478 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.698228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.699885 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac43c04-1b1c-425b-a58f-47aeab28776b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.711217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1189/2386] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:00.728486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:00.806926 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88f95ac-ca51-43d2-96e5-018606f08514 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:00.815629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:00.816565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:00.816854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:00.817139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] PATH_INFO: `/v3/users/405901951a6c436db2ae76ffb5b30234` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:00.818400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=405901951a6c436db2ae76ffb5b30234)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:00.820354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:00.999432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '405901951a6c436db2ae76ffb5b30234'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:01.018090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '405901951a6c436db2ae76ffb5b30234'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:01.025613 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '405901951a6c436db2ae76ffb5b30234'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:01.104376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '405901951a6c436db2ae76ffb5b30234'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:01.105000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '405901951a6c436db2ae76ffb5b30234'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:01.112215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1198/2387] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:24:00 2022] DELETE /identity/v3/users/405901951a6c436db2ae76ffb5b30234 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:01.116721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:01.117266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:01.117266 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:01.135022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:01.136275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:01.214694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1190/2388] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:01.224619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:01.230887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:01.291811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a113ba-56be-41f6-9a6e-ab58f5ec55f6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:01.296206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:01.297085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:01.297455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:01.297812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:01.308064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:01.309569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0642d7-6a8a-49c3-a5d9-b7cd968a5b17 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:01.320947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1199/2389] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:01.838320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:01.839741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:01.858757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f82dad-35db-480c-a7d5-807d8c3cb229 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:01.863912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:01.864828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:01.865107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:01.865404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] PATH_INFO: `/v3/projects/4dfd0d1500b1482fbe84e98665a83158` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:01.866594 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfd0d1500b1482fbe84e98665a83158)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:01.868627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.040549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfd0d1500b1482fbe84e98665a83158', 'request_id': 'req-cdf62d1a-b970-4863-a699-46337cc9b0b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:02.060222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfd0d1500b1482fbe84e98665a83158', 'request_id': 'req-cdf62d1a-b970-4863-a699-46337cc9b0b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:02.065348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:02.134149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfd0d1500b1482fbe84e98665a83158', 'request_id': 'req-cdf62d1a-b970-4863-a699-46337cc9b0b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:02.145781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] The token cache is being invalidate because project 4dfd0d1500b1482fbe84e98665a83158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:24:02.146070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:02.153547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cdf62d1a-b970-4863-a699-46337cc9b0b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:02.153547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1191/2390] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:24:01 2022] DELETE /identity/v3/projects/4dfd0d1500b1482fbe84e98665a83158 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:02.154263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745026e-9948-4228-88be-91e55b228278 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.154263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745026e-9948-4228-88be-91e55b228278 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.154919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5745026e-9948-4228-88be-91e55b228278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.173518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-5745026e-9948-4228-88be-91e55b228278 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:02.174733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5745026e-9948-4228-88be-91e55b228278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:02.183108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:02.234640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1200/2391] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:24:02.242224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.242512 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.242800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.261108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:02.262303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:02.270778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1192/2392] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:02.274961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745026e-9948-4228-88be-91e55b228278 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.287085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5745026e-9948-4228-88be-91e55b228278 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.291803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.292523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.292814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.293094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.293838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:24:02.294153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.295800 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.308016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1201/2393] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:24:02.312604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.321902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ac4c2-ee8d-4053-8324-2872bfa1fc80 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.327108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.327740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.328320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.328447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.329069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.330966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.410390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1193/2394] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:24:02 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:24:02.415299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.425764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b3e081-9313-4287-ae29-b4a8b7d36527 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.481622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.482293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.482583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.482863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.483665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.485754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.576275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1202/2395] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:24:02 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:24:02.581584 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.604762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6aea63-b2d3-43e4-a164-6bd306cc059e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.611639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.621514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.621514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.621514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.621514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.621514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.641526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1194/2396] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:24:02.645198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.657580 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3310226e-8e4d-484f-aee6-eff8e3024bb6 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.662934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.663731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.664064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.664387 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.665139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.666870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def42c76-e47d-4902-a4c2-9999f93d74c9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.679158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1203/2397] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:24:02.682783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.699679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ace16-6ead-42aa-8498-94d1e73e6b99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:02.710538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:02.711619 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.711994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.712371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] PATH_INFO: `/v3/projects/f6bf9df298f14425a3b520ca8ff1efc3/users/5d768caf893e44bc98cfae5accf82b62/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.729954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bf9df298f14425a3b520ca8ff1efc3, user_id=5d768caf893e44bc98cfae5accf82b62, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:02.732697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:02.832343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1195/2398] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:24:02 2022] PUT /identity/v3/projects/f6bf9df298f14425a3b520ca8ff1efc3/users/5d768caf893e44bc98cfae5accf82b62/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:02.842521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:02.842812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:02.843093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:02.870594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] MFA Rules not processed for user `5d768caf893e44bc98cfae5accf82b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:02.871829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:02.943975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1204/2399] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:02.955800 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:02.957544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:03.040999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341cebd-53a8-4885-90f6-160df28bb036 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:03.045870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:03.046921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:03.047277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:03.047625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:03.059004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:03.062367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa176665-6c8c-423b-9793-db00512973ce service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:03.072852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1196/2400] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:07.838828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:07.850139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:07.907549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4981cc-3659-4e91-be28-9e2de4707531 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:07.912720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:07.913619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:07.913900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:07.914175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] PATH_INFO: `/v3/users/5d768caf893e44bc98cfae5accf82b62` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:07.915354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d768caf893e44bc98cfae5accf82b62)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:07.917646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:08.095997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d768caf893e44bc98cfae5accf82b62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:08.108325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d768caf893e44bc98cfae5accf82b62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:08.115151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d768caf893e44bc98cfae5accf82b62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:08.157296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d768caf893e44bc98cfae5accf82b62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:08.157889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d768caf893e44bc98cfae5accf82b62'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:08.164734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1205/2401] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:24:07 2022] DELETE /identity/v3/users/5d768caf893e44bc98cfae5accf82b62 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:08.169724 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:08.173602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:08.173602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:08.187764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:08.188985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:08.245755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1197/2402] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:08.255814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:08.259561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:08.325281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0822e-a066-467b-a5f3-58597fa95b8f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:08.329076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:08.329732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:08.330018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:08.330294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:08.339883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:08.341812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465a192-dd90-4ca8-9d91-fe339eb76529 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:08.352734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1206/2403] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:08.832239 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:08.836692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:08.861126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf66fbe-c244-4906-a0a9-9b58a08c2e13 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:08.866790 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:08.867762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:08.868109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:08.868418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] PATH_INFO: `/v3/projects/f6bf9df298f14425a3b520ca8ff1efc3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:08.869604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bf9df298f14425a3b520ca8ff1efc3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:08.871494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:08.901707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:08.998175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bf9df298f14425a3b520ca8ff1efc3', 'request_id': 'req-acb5773a-a89e-4418-a9d9-357f29adf1e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:09.009934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bf9df298f14425a3b520ca8ff1efc3', 'request_id': 'req-acb5773a-a89e-4418-a9d9-357f29adf1e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:09.031443 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.031995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.031995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.049690 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:09.050900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:09.070534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bf9df298f14425a3b520ca8ff1efc3', 'request_id': 'req-acb5773a-a89e-4418-a9d9-357f29adf1e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:09.078451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] The token cache is being invalidate because project f6bf9df298f14425a3b520ca8ff1efc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:24:09.079023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:09.079148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:09.079432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-acb5773a-a89e-4418-a9d9-357f29adf1e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:09.081007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1198/2404] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:24:08 2022] DELETE /identity/v3/projects/f6bf9df298f14425a3b520ca8ff1efc3 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:09.086839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489efd0-95f4-44d3-94a2-8c5f7b34a13d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.087675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489efd0-95f4-44d3-94a2-8c5f7b34a13d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.087675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489efd0-95f4-44d3-94a2-8c5f7b34a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.109092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8489efd0-95f4-44d3-94a2-8c5f7b34a13d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:09.110430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8489efd0-95f4-44d3-94a2-8c5f7b34a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:09.111038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1207/2405] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:24:09.124084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.125816 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:09.172040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1199/2406] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:24:09.180739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.180992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.181277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.198850 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678118e-370d-4cc2-97bb-ebe13e959db9 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.204806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.204961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:09.205455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.205740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.206016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.206116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:09.214018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1200/2407] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:24:09.214284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.216570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.218831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.225155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1208/2408] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:24:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:24:09.231595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a13523-8a73-473e-987f-9dfc6f5bae16 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.234653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.235483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.235829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.236277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.237208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:24:09.237583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.239271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.252391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1201/2409] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:24:09.257271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.269283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9adc2-cc1b-426e-943f-3986d01568f0 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.275951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.277389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.277389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.277389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.278229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.280949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.383615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1209/2410] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/projects => generated 365 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:24:09.388416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.398736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec117f37-ddfe-4f20-92dd-51be6a79d555 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.485114 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.486754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.487302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.487783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.488926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.491550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.566098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1202/2411] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:24:09.571174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.586189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d2a26-322f-4205-8ae5-d186d7bbd2af admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.592872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.594616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.595046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.595566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.596494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.598805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.614202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1210/2412] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:24:09.619426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.633816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca362d-bbcb-4be1-a116-89f511592328 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.641368 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.642946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.642946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.643305 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.644298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.646259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1347a-2059-4b0d-97dd-2ee596cb0ba3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.664075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1203/2413] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:24:09.665310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.675961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf634a0-41fd-49fa-b1c4-6116cf06dcfe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:09.680602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:09.681500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.681831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.682107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] PATH_INFO: `/v3/projects/3e8bd0ecf5f84a229e66ccd8cb46858b/users/7aa6476735f147ef9c9c2a4c94b61858/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.697721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e8bd0ecf5f84a229e66ccd8cb46858b, user_id=7aa6476735f147ef9c9c2a4c94b61858, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:09.701234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:09.771832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1211/2414] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:24:09 2022] PUT /identity/v3/projects/3e8bd0ecf5f84a229e66ccd8cb46858b/users/7aa6476735f147ef9c9c2a4c94b61858/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:24:09.782720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:09.783017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:09.783299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:09.805211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:09.818030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] MFA Rules not processed for user `7aa6476735f147ef9c9c2a4c94b61858`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:09.819205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:09.909163 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1204/2415] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:09.921198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:09.923088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:10.140033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5240de92-f92d-4a78-85c8-622c43241d6b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:10.140033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:10.140033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:10.140033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:10.140927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:10.140927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:10.140927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2da78-33e7-42c7-9b40-652a345b87b3 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:10.140927 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1212/2416] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:11.221181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:11.222685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:11.362345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d973e69d-2eaa-4a36-b1c7-23538e0de46f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:11.368149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:11.368815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:11.369101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:11.369519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:11.372577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:11.389694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:11.391954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:11.410908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1205/2417] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:19.030130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25d89-c197-4c3a-9fc2-461cd1c7d207 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:19.030698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25d89-c197-4c3a-9fc2-461cd1c7d207 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:19.030698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec25d89-c197-4c3a-9fc2-461cd1c7d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:19.054154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4ec25d89-c197-4c3a-9fc2-461cd1c7d207 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:19.055948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ec25d89-c197-4c3a-9fc2-461cd1c7d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:19.063383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:19.220094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1213/2418] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:24:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:19.220489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:19.391513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c3d96-202e-4f3b-ae9b-d5a7c5a77944 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:19.396647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:19.397285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:19.397571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:19.397845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:19.407663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:19.409356 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddd03f7-9be4-4838-a941-96baf8048ac5 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:19.418504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1206/2419] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:24:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:24:25.843375 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:25.843866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:25.843965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:25.868657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] MFA Rules not processed for user `4e2e7a78e68345e19fc7c3cc9b334d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:25.870424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:25.949752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1214/2420] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:29.416425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:29.730052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:29.730661 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:29.731780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:29.753914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:29.755415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:29.765055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1207/2421] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:24:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:29.781349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:29.804160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadaff2e-07f0-463e-b5b9-dba071d045de None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:29.818490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:29.819815 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:29.820168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:29.820453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:29.831179 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:29.832846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:29.842725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1215/2422] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:24:33.396398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:33.398053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:33.407063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:33.408780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:33.499567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90322bd-ba60-4102-a7a4-640895aba5b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:33.502587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99bcaef-8d11-4a32-9109-dbb9b8a34d11 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:33.504408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:33.505526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:33.505728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:33.506167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:33.507686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:33.508616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:33.509072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:33.509611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] PATH_INFO: `/v3/users/4280f30d5f48431db44ed2f7b20e07da` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:33.511087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4280f30d5f48431db44ed2f7b20e07da)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:33.512750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:33.513401 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:33.584788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:33.586276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:33.597188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1208/2423] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:33.701917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4280f30d5f48431db44ed2f7b20e07da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:33.703713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:33.715037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4280f30d5f48431db44ed2f7b20e07da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:33.725283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4280f30d5f48431db44ed2f7b20e07da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:33.824210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4280f30d5f48431db44ed2f7b20e07da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:33.825466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-65537cd8-a8bc-4ea6-968a-5c4e40eb98b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4280f30d5f48431db44ed2f7b20e07da'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:33.845521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1216/2424] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:24:33 2022] DELETE /identity/v3/users/4280f30d5f48431db44ed2f7b20e07da => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:24:34.175556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:34.189411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b3c29-7d88-40e7-9e16-a12c32a0734b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:34.253920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:34.254704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:34.254988 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:34.255284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] PATH_INFO: `/v3/projects/d9e678a29d004fdc9ff3133e29b58854` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:34.256484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9e678a29d004fdc9ff3133e29b58854)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:34.258421 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:34.392922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9e678a29d004fdc9ff3133e29b58854', 'request_id': 'req-0ee7971a-bca6-4a78-a54c-2a5d092b5406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:34.400253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:34.401783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9e678a29d004fdc9ff3133e29b58854', 'request_id': 'req-0ee7971a-bca6-4a78-a54c-2a5d092b5406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:34.486994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9e678a29d004fdc9ff3133e29b58854', 'request_id': 'req-0ee7971a-bca6-4a78-a54c-2a5d092b5406'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:34.510210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] The token cache is being invalidate because project d9e678a29d004fdc9ff3133e29b58854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:24:34.510753 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:34.511445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ee7971a-bca6-4a78-a54c-2a5d092b5406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:34.513387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1209/2425] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:24:34 2022] DELETE /identity/v3/projects/d9e678a29d004fdc9ff3133e29b58854 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:42.249410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:42.249883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:42.250003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:42.268759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] MFA Rules not processed for user `d1e1edac4a2f430ea534bf4911988d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:42.269980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:42.326099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1217/2426] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:44.556555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:47.566490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:47.567169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:47.567169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:47.596682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:47.597923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:47.661018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1210/2427] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:47.675864 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:47.677312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:47.774000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e1c6c3-bc5f-4217-860b-559e25e85c45 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:47.782156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:47.782824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:47.783113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:47.783392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:47.793669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:47.795886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019810e1-4754-4fb5-bc94-1a491d6dc049 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:47.806653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1218/2428] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:49.068680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:49.070351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:49.082901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f216a24-de57-40b0-9e27-1d2215970344 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:49.087552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:49.088496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:49.088780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:49.089061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] PATH_INFO: `/v3/users/7aa6476735f147ef9c9c2a4c94b61858` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:49.090257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa6476735f147ef9c9c2a4c94b61858)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:49.092876 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:49.352913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa6476735f147ef9c9c2a4c94b61858'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:49.364711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa6476735f147ef9c9c2a4c94b61858'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:49.371674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa6476735f147ef9c9c2a4c94b61858'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:49.424925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa6476735f147ef9c9c2a4c94b61858'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:49.425532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa6476735f147ef9c9c2a4c94b61858'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:49.431492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1211/2429] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:24:49 2022] DELETE /identity/v3/users/7aa6476735f147ef9c9c2a4c94b61858 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:49.436803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:49.437259 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:49.437350 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:49.454240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:49.455431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:49.505203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:49.514551 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1219/2430] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:49.527012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:49.534701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:49.615733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7eda-6d86-486f-b8e2-844053b70f78 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:49.621504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:49.622155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:49.622441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:49.622713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:49.633432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:49.634975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efdca9-d34c-44a2-98a0-08be4a2d288d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:49.645843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1212/2431] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:50.163519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:50.165547 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:50.178977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1f623a-b8c8-4459-9e9a-ce0b2c82c2fa None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:50.184674 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:50.190409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:50.190409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:50.190409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] PATH_INFO: `/v3/projects/3e8bd0ecf5f84a229e66ccd8cb46858b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:50.190409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e8bd0ecf5f84a229e66ccd8cb46858b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:50.190409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:50.328817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e8bd0ecf5f84a229e66ccd8cb46858b', 'request_id': 'req-78024f07-53e9-4487-88da-83f220dcd664'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:50.336279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e8bd0ecf5f84a229e66ccd8cb46858b', 'request_id': 'req-78024f07-53e9-4487-88da-83f220dcd664'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:50.402285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e8bd0ecf5f84a229e66ccd8cb46858b', 'request_id': 'req-78024f07-53e9-4487-88da-83f220dcd664'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:50.420860 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] The token cache is being invalidate because project 3e8bd0ecf5f84a229e66ccd8cb46858b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:24:50.421160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:50.421898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:24:50.423807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1220/2432] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:24:50 2022] DELETE /identity/v3/projects/3e8bd0ecf5f84a229e66ccd8cb46858b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:24:51.025624 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62130-46d2-4f5e-9764-f5a708136e66 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:51.026194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62130-46d2-4f5e-9764-f5a708136e66 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:51.026194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62130-46d2-4f5e-9764-f5a708136e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:51.044387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38c62130-46d2-4f5e-9764-f5a708136e66 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:51.045643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38c62130-46d2-4f5e-9764-f5a708136e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:51.054796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:24:51.103316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1213/2433] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:51.123970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:51.125425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:51.198687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78024f07-53e9-4487-88da-83f220dcd664 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:51.204689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:51.205333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:51.205622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:51.205901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:51.214099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:51.215693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:51.225773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1221/2434] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:53.882892 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270456dd-1995-41f9-bfc0-a6f326f3cdac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:53.883402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270456dd-1995-41f9-bfc0-a6f326f3cdac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:53.883508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270456dd-1995-41f9-bfc0-a6f326f3cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:53.906877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-270456dd-1995-41f9-bfc0-a6f326f3cdac None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:53.908263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-270456dd-1995-41f9-bfc0-a6f326f3cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:53.922968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1214/2435] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:53.969840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:53.971335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:53.986118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30046bdc-91ef-40f8-993d-8a976b2c7de9 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:53.991711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:53.992392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:53.992683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:53.992963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:54.001615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:54.003203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:54.013319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1222/2436] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:24:57.082876 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8578-8dc9-46a4-b9e5-6ad946cbf3ef None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:57.083387 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8578-8dc9-46a4-b9e5-6ad946cbf3ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:57.083494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b8578-8dc9-46a4-b9e5-6ad946cbf3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:57.100915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-865b8578-8dc9-46a4-b9e5-6ad946cbf3ef None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:24:57.102085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-865b8578-8dc9-46a4-b9e5-6ad946cbf3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:24:57.110318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1215/2437] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:24:57.126055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:24:57.137701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ed6d5-f1e8-4038-81a2-56e8e1b59cd7 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:24:57.143236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:24:57.146255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:24:57.146255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:24:57.146255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:24:57.152695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:24:57.154291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:24:57.163917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1223/2438] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:24:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:01.362466 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651aaa5-d5c5-402b-bc55-6485caded324 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:01.362924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651aaa5-d5c5-402b-bc55-6485caded324 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:01.363034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d651aaa5-d5c5-402b-bc55-6485caded324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:01.381320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d651aaa5-d5c5-402b-bc55-6485caded324 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:01.382510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d651aaa5-d5c5-402b-bc55-6485caded324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:01.390975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1216/2439] 10.222.0.58 () {58 vars in 1016 bytes} [Tue Jul 12 18:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:01.434427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:01.446610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10095bdc-d264-4d99-89ff-99c9fb97cf8d service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:01.452195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:01.452848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:01.453143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:01.453426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:01.461637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:01.463213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd0aa6-5d73-4eb6-8405-806263006e3c service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:01.472643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1224/2440] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:25:11.376686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=29 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:11.468410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:12.678602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:12.679171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:12.679171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:12.697359 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] MFA Rules not processed for user `c39a7058d0e1423f8d8464eb4c09e490`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:12.698628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:12.758705 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1217/2441] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:25:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:22.740825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:22.741347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:22.741453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:22.746662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=25 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:22.758813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] MFA Rules not processed for user `50724984775d4248a5975459d8c2c76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:25:22.760084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:22.824084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1225/2442] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:25:32.817594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=25 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:37.127066 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:37.132714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:25:37.142803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202350d-364c-4811-a1fe-ebb4050b268b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:37.147575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:37.148580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:37.148949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:37.149335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] PATH_INFO: `/v3/users/4e2e7a78e68345e19fc7c3cc9b334d58` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:37.150597 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2e7a78e68345e19fc7c3cc9b334d58)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:37.152723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:37.348323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2e7a78e68345e19fc7c3cc9b334d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.360831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2e7a78e68345e19fc7c3cc9b334d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.367763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2e7a78e68345e19fc7c3cc9b334d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.424585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2e7a78e68345e19fc7c3cc9b334d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.425200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4869623a-4f3f-4877-800a-b079b50f15a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2e7a78e68345e19fc7c3cc9b334d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.431896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1218/2443] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:25:37 2022] DELETE /identity/v3/users/4e2e7a78e68345e19fc7c3cc9b334d58 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:25:37.670993 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:25:37.685169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bf2311-06b5-400b-b6b4-4e6b91d47c09 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:25:37.755518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:25:37.756438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:25:37.758871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:25:37.758871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] PATH_INFO: `/v3/projects/9af1057ef88e4ae2aba37b90a30a5af4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:25:37.758871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af1057ef88e4ae2aba37b90a30a5af4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:25:37.760797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:25:37.869866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af1057ef88e4ae2aba37b90a30a5af4', 'request_id': 'req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.877678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af1057ef88e4ae2aba37b90a30a5af4', 'request_id': 'req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.956811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af1057ef88e4ae2aba37b90a30a5af4', 'request_id': 'req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.971515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] The token cache is being invalidate because project 9af1057ef88e4ae2aba37b90a30a5af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:25:37.971958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.972770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:25:37.974424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1226/2444] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:25:37 2022] DELETE /identity/v3/projects/9af1057ef88e4ae2aba37b90a30a5af4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:25:47.427910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:25:47.966311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:01.105213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:01.105725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:01.105835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:01.122518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] MFA Rules not processed for user `d1e1edac4a2f430ea534bf4911988d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:01.123713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:01.181863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1219/2445] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:05.478092 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:05.479577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:05.547967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b3f9d-0bfe-4dde-a00d-58968ff39a25 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:05.553235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:05.553897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:05.554180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:05.554456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:05.556301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:05.644469 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:05.645924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:05.658566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1227/2446] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:08.367942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:08.367942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:08.380289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57643f7b-9757-48f6-b955-877465c904f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:08.383712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:08.384377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:08.384662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:08.384941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:08.386620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:08.399339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:08.400801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:08.412595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1220/2447] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:14.167537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:14.178500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0119f3-dc4b-46c6-ba95-094dc74b4c82 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:14.189604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:14.189604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:14.189604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:14.189604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:14.190620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:14.256655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:14.258099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:14.268261 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1228/2448] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:14.473493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:14.475194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:14.489580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7653019-e2a4-4998-aac9-881c5046e6de service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:14.495034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:14.496623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:14.496934 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:14.497243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:14.499025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:14.510115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:14.511711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:14.521085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1221/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:18.465531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:18.467067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:18.483772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6ae5f-d47b-449f-ba6d-32d4e15cb81b service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:18.488874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:18.489741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:18.490023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:18.490293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] PATH_INFO: `/v3/users/c39a7058d0e1423f8d8464eb4c09e490` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:18.491566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c39a7058d0e1423f8d8464eb4c09e490)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:18.493786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:18.676637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:18.691186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c39a7058d0e1423f8d8464eb4c09e490'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:18.702628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c39a7058d0e1423f8d8464eb4c09e490'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:18.709274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c39a7058d0e1423f8d8464eb4c09e490'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:18.772191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c39a7058d0e1423f8d8464eb4c09e490'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:18.772754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-5ab6a1cb-e641-41a3-8157-cfd69fa1b270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c39a7058d0e1423f8d8464eb4c09e490'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:18.778985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1229/2450] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:26:18 2022] DELETE /identity/v3/users/c39a7058d0e1423f8d8464eb4c09e490 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:19.100260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.112971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0662308-80d0-4dab-a5e0-5a15d46228d8 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.170477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.171339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.171625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.171900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] PATH_INFO: `/v3/projects/0dd56876c32242128356a63e830c6d09` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.173126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd56876c32242128356a63e830c6d09)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.175684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.281533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd56876c32242128356a63e830c6d09', 'request_id': 'req-db7571d0-e64b-4c29-b2c6-070349394eb2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:19.289064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd56876c32242128356a63e830c6d09', 'request_id': 'req-db7571d0-e64b-4c29-b2c6-070349394eb2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:19.349820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd56876c32242128356a63e830c6d09', 'request_id': 'req-db7571d0-e64b-4c29-b2c6-070349394eb2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:19.360322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] The token cache is being invalidate because project 0dd56876c32242128356a63e830c6d09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:26:19.362198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:19.362198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-db7571d0-e64b-4c29-b2c6-070349394eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:19.362825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1222/2451] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:26:19 2022] DELETE /identity/v3/projects/0dd56876c32242128356a63e830c6d09 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:19.368103 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.368434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.368712 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.386027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:19.387508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:19.446344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1230/2452] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:19.453712 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.454026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.454314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.473211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:19.474400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:19.483053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1223/2453] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:19.487252 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.497124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e2097-0597-457a-97f3-1278cc3fca0c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.501618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.502293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.502584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.502855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.503573 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:26:19.503879 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.505488 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.516906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1231/2454] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:26:19.521477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.525888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:19.531160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0427e9a-3dec-4ed0-9d43-f20126e3c9a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.536639 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.538377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.538377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.538377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.538626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.540604 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.688765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1224/2455] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:19.693557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.703414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a8c430-6178-4eec-83a4-06a94860d2ee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.758731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.759402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.759689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.759969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.760683 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.762582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.824590 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1232/2456] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:26:19 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:19.828626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.839156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fda8c-53ea-47c1-a164-6152dc682aa0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.844436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.845112 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.845398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.845677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.846924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.848577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.858549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1225/2457] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:26:19.863014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.872865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e3ea2-5895-4452-b30d-c8a161f07dcd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.877405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.878056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.878363 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.878647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.879370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.880994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b17d1d2-ce54-4a60-9161-e540382ec6b3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.890871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1233/2458] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:26:19.896607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:19.906378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5229bfe-b371-499f-8032-5ac24c1f43af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:19.911690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:19.912588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:19.912868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:19.913137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] PATH_INFO: `/v3/projects/8ecf9aaff101455b8898d4fcd4c41e80/users/86793fe260194cd196a7a586d6330c8d/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:19.927658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ecf9aaff101455b8898d4fcd4c41e80, user_id=86793fe260194cd196a7a586d6330c8d, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:19.930302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:19.995492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1226/2459] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:26:19 2022] PUT /identity/v3/projects/8ecf9aaff101455b8898d4fcd4c41e80/users/86793fe260194cd196a7a586d6330c8d/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:20.006105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.006395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.006675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.024339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:20.026079 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.031148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:20.034677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] MFA Rules not processed for user `86793fe260194cd196a7a586d6330c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:20.035951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.099117 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1234/2460] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:20.100235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d043cc0-0c14-480d-9001-48c9aa9dec95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:20.105960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:20.106605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.106888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.107166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.109023 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.110135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:20.111512 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.128371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add8e87-f02e-484a-8cf4-dccc2340136b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:20.134427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:20.135072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.135355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.135630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.144139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:20.146053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:20.156687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1235/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:26:20.170195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:20.171807 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b975b226-a2dc-44b4-9a03-77e45d7b79a2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:20.180766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1227/2462] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:26:20.374840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:20.435748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51306619-2914-4ab7-8173-c9c8f4bea806 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:20.441136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:20.442060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.442343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.442621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] PATH_INFO: `/v3/users/86793fe260194cd196a7a586d6330c8d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.443828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86793fe260194cd196a7a586d6330c8d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:20.445837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:20.631456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86793fe260194cd196a7a586d6330c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:20.643903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86793fe260194cd196a7a586d6330c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:20.650629 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86793fe260194cd196a7a586d6330c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:20.725774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86793fe260194cd196a7a586d6330c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:20.726398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86793fe260194cd196a7a586d6330c8d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:20.732453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1236/2463] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:26:20 2022] DELETE /identity/v3/users/86793fe260194cd196a7a586d6330c8d => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:20.737648 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.737939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.740768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.755094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:20.756327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.794227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:20.814613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1228/2464] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:20.824262 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:20.825701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:20.837182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:20.883668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35bf87c-b65a-44b7-97a6-2c3dfde5eeb2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:20.887412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:20.888063 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:20.888389 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:20.888670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:20.898432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:20.899891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046112a-30a8-4827-86cb-29a7fb401853 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:20.910313 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1237/2465] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:21.328723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:21.333077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:21.342841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e9d33-047c-4e16-a4ce-7acad701a58c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:21.347347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:21.348248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.348530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.348803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] PATH_INFO: `/v3/projects/8ecf9aaff101455b8898d4fcd4c41e80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.349968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ecf9aaff101455b8898d4fcd4c41e80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:21.351881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:21.488711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ecf9aaff101455b8898d4fcd4c41e80', 'request_id': 'req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:21.495060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ecf9aaff101455b8898d4fcd4c41e80', 'request_id': 'req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:21.561742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ecf9aaff101455b8898d4fcd4c41e80', 'request_id': 'req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:21.573650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] The token cache is being invalidate because project 8ecf9aaff101455b8898d4fcd4c41e80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:26:21.573938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:21.574636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6aa1ace-6cf5-4266-aa5b-5e8dfeb2fde0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:26:21.576269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1229/2466] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:26:21 2022] DELETE /identity/v3/projects/8ecf9aaff101455b8898d4fcd4c41e80 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:21.581266 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.581553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.581827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.599098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:21.600522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:21.659360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1238/2467] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:26:21.667026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.667319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.667602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.685845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:21.687015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:21.695453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1230/2468] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:21.699497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:21.709362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3d292-81bc-412e-9ee6-41facacd0f57 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:21.714073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:21.715089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.715374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.715649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.716565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:26:21.716871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:21.718450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:21.729915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1239/2469] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:26:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:26:21.733944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:21.743452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41175e26-a405-49cf-8c22-6a86c1f7866f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:21.747973 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:21.748638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.748920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.749197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.749874 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:21.751755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:21.865425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1231/2470] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:26:21 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:21.869621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:21.880433 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d0508-bd93-4c4e-b383-272ba1ac6af8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:21.937000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:21.937592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:21.937876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:21.938148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:21.938888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:21.940820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.041300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1240/2471] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:26:21 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:22.045330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.056191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180f3ca-a59b-41e0-87dc-dd2a130974d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.060699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.061345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.061660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.061945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.062691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.064482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.075226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1232/2472] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:26:22.079165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.096548 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82ddba-4f1e-4e1a-95cb-34b005ffdc91 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.102426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.103168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.103464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.103783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.104516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.106310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700f771-3753-4f4b-adb7-ad4b0f695985 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.117898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1241/2473] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:26:22.122645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.133200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14074d3-7d49-4a46-a716-950395d8c668 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.137901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.138781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.139126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.139472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] PATH_INFO: `/v3/projects/ffde7093722b4281a994d6dfdd2a2945/users/c76fe3cc2d424724aea22ed88e2296e5/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.155474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffde7093722b4281a994d6dfdd2a2945, user_id=c76fe3cc2d424724aea22ed88e2296e5, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.158145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.292567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1233/2474] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:26:22 2022] PUT /identity/v3/projects/ffde7093722b4281a994d6dfdd2a2945/users/c76fe3cc2d424724aea22ed88e2296e5/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:22.302724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.303017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.303301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.329227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] MFA Rules not processed for user `c76fe3cc2d424724aea22ed88e2296e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:22.330954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:22.335906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:22.397530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1242/2475] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:22.401915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.467130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e0422-eccd-4c38-b9bb-ff2118486ebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.472696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.473342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.473626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.473901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.474638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.476537 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.480451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:22.586883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1234/2476] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:26:22 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:22.591143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.602949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd363a-a7c1-4687-a675-d8a81aed654f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.669345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.670035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.670296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.670574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.671292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.673558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.774158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1243/2477] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:26:22 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:26:22.779873 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.790509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb19035-ad45-4d96-9885-1b518d9d535d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.795095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.795691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.795978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.796291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.797020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.798613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.809045 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1235/2478] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:26:22.813564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.824100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863818-27eb-4190-8700-f2848d5d9310 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:22.828631 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:22.829510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:22.829793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:22.830074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] PATH_INFO: `/v3/projects/63235419e8c44aab99e1a995170806d7/users/c6add3638e3e487ba6f68440db7afaea/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:22.846207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=63235419e8c44aab99e1a995170806d7, user_id=c6add3638e3e487ba6f68440db7afaea, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:22.848901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:22.944966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1244/2479] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:26:22 2022] PUT /identity/v3/projects/63235419e8c44aab99e1a995170806d7/users/c6add3638e3e487ba6f68440db7afaea/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:22.948920 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:22.959638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f18287-354c-4af2-95b1-977b9789c221 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:23.019434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:23.020100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:23.020409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:23.020690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:23.021413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:23.023017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b496ac-9653-404a-a5c1-08a1d866d182 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:23.032579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1236/2480] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:26:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:26:23.037003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:23.047084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3713cab-7fb5-42cb-a485-9e870d06d94c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:23.052429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:23.053320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:23.053606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:23.053887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] PATH_INFO: `/v3/projects/63235419e8c44aab99e1a995170806d7/users/c6add3638e3e487ba6f68440db7afaea/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:23.055853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63235419e8c44aab99e1a995170806d7, user_id=c6add3638e3e487ba6f68440db7afaea, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:23.058531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:23.070309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1245/2481] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:26:23 2022] PUT /identity/v3/projects/63235419e8c44aab99e1a995170806d7/users/c6add3638e3e487ba6f68440db7afaea/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:26:23.080172 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:23.080503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:23.080782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:23.107143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] MFA Rules not processed for user `c6add3638e3e487ba6f68440db7afaea`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:23.108380 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:23.175536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1237/2482] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:26:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:23.186135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:23.187834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:23.244795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7c6cd-2730-4fa6-a747-48207060ff3a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:23.248374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:23.249008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:23.249292 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:23.249569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:23.258887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:23.260335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251a69b-c695-4fc5-b164-82ae0dd4e791 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:23.269506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1246/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:23.465541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:23.475879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c5bc9-ef46-41e8-8807-335fdd68193f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:23.479516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:23.480195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:23.480489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:23.480767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:23.534133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:23.536696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:23.538152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:23.550017 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1238/2484] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:33.265372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:33.594840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:34.959310 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:34.959831 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:34.959929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:34.978096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:34.983067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:35.036507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1247/2485] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:35.165751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:35.167224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:35.249333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c851fc-6e64-46a8-b81b-47ac8bdbbc68 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:35.254935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:35.255577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:35.255858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:35.256154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:35.264052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:35.265663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:35.273654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1239/2486] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:45.030503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=25 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:45.270880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=32 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:26:46.538979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:46.540536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:46.594955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffedb33-9b8f-4603-83c8-5ac99297e68a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:46.599421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:46.600073 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:46.600372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:46.600648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:46.602374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:46.611961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:46.613423 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d1506-1418-4915-9275-f0495276cd8f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:46.621698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1248/2487] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:51.496396 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:51.497791 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:51.568461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9835f20f-5789-4d7a-bcfd-9f818987954d service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:51.577593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:51.577593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:51.577593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:51.577593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:51.578030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:51.589306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:51.590893 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:51.600860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1240/2488] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:26:55.252305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:55.254596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:55.254596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:55.271618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:26:55.272833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:55.279946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1249/2489] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:26:55.292732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:55.311680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a938-c8f2-4a53-a74a-165daeff9d21 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:55.311680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:55.311680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:55.311680 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:55.312064 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:55.322289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:55.324058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:55.332408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1241/2490] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:26:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:26:57.831763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:26:57.833919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:57.925062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3edae-f978-4418-bd5c-12ecfe70918b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:26:57.931147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:26:57.932461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:26:57.932461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:26:57.932785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:26:57.934894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:26:57.950236 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:26:57.952007 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e93f37-14b2-4d1a-b7ba-5ca198a1bd7a service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:26:57.964774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1250/2491] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:26:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:00.418752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:00.488592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af430191-fe93-4386-a271-e7affaac1ff7 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:00.493274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:00.494271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:00.494658 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:00.495036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] PATH_INFO: `/v3/users/c76fe3cc2d424724aea22ed88e2296e5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:00.496363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c76fe3cc2d424724aea22ed88e2296e5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:00.499102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:00.664676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c76fe3cc2d424724aea22ed88e2296e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:00.678860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c76fe3cc2d424724aea22ed88e2296e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:00.686767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c76fe3cc2d424724aea22ed88e2296e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:00.690850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:00.767131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c76fe3cc2d424724aea22ed88e2296e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:00.768287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c76fe3cc2d424724aea22ed88e2296e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:00.775997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1242/2492] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:00 2022] DELETE /identity/v3/users/c76fe3cc2d424724aea22ed88e2296e5 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:00.780917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:00.781526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:00.781526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:00.811872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:00.813610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:00.942504 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1251/2493] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:00.950085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:00.951579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:01.017024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa6c1c-e2ae-4bc9-8613-d7deef0cacd1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:01.022042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:01.022898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:01.023187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:01.023467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:01.034334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:01.036474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:01.047489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1243/2494] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:01.490180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:01.491637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:01.504609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f21a06-a099-46e7-af93-e4b9e56ab60b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:01.515096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:01.516241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:01.516537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:01.516821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] PATH_INFO: `/v3/projects/ffde7093722b4281a994d6dfdd2a2945` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:01.518037 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffde7093722b4281a994d6dfdd2a2945)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:01.520538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:01.544055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:01.639188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffde7093722b4281a994d6dfdd2a2945', 'request_id': 'req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:01.646695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffde7093722b4281a994d6dfdd2a2945', 'request_id': 'req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:01.709761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffde7093722b4281a994d6dfdd2a2945', 'request_id': 'req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:01.721036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] The token cache is being invalidate because project ffde7093722b4281a994d6dfdd2a2945 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:01.721344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:01.722053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:01.723978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1252/2495] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:01 2022] DELETE /identity/v3/projects/ffde7093722b4281a994d6dfdd2a2945 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:01.727987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:01.741898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a757c4-ffb0-460d-aad1-e957283f9b62 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:01.829186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:01.830081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:01.830379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:01.830667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] PATH_INFO: `/v3/users/c6add3638e3e487ba6f68440db7afaea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:01.832528 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6add3638e3e487ba6f68440db7afaea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:01.834463 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:02.045188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6add3638e3e487ba6f68440db7afaea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:02.058383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6add3638e3e487ba6f68440db7afaea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:02.080372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6add3638e3e487ba6f68440db7afaea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.172974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6add3638e3e487ba6f68440db7afaea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.193931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b620386-319e-4695-8c15-7eceb6d9898c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6add3638e3e487ba6f68440db7afaea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.193931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1244/2496] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:01 2022] DELETE /identity/v3/users/c6add3638e3e487ba6f68440db7afaea => generated 0 bytes in 1454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:03.677329 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:03.680324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:03.692797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3335ca3-3453-41bc-bd2e-74aba3f0d4ba admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:03.749270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:03.750132 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:03.750417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:03.750694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] PATH_INFO: `/v3/projects/63235419e8c44aab99e1a995170806d7` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:03.751861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63235419e8c44aab99e1a995170806d7)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:03.754501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:03.853230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63235419e8c44aab99e1a995170806d7', 'request_id': 'req-30a90304-2642-4c97-bc35-92dc7957c5b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.859371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63235419e8c44aab99e1a995170806d7', 'request_id': 'req-30a90304-2642-4c97-bc35-92dc7957c5b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.927617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63235419e8c44aab99e1a995170806d7', 'request_id': 'req-30a90304-2642-4c97-bc35-92dc7957c5b8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.938564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] The token cache is being invalidate because project 63235419e8c44aab99e1a995170806d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:03.938854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.939486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-30a90304-2642-4c97-bc35-92dc7957c5b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:03.941061 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1253/2497] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:03 2022] DELETE /identity/v3/projects/63235419e8c44aab99e1a995170806d7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:03.945937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:03.951499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:03.951499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:03.964508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:03.965808 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:03.978249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:04.024218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1245/2498] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:04.032620 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.032910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.033189 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.053649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:04.054839 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:04.062597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1254/2499] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:04.066702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.076339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9743fd-eb36-4505-9773-68d4c2903207 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.080854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.081501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.081789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.082058 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.082772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:04.083074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.084757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.096474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1246/2500] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:04.101257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.110587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06535ee-7ed7-4e1d-b7ff-95ec7fd990d4 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.116028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.116721 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.117003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.117276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.117965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.119921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.211982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1255/2501] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:04.213309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.224762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec33245-ffe7-4080-9e3f-91d9f3a849f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.290708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.291446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.291729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.292027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.292748 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.294669 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.420222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1247/2502] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:04.421444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.435312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5e694-df43-44f5-b43a-667c5ee34467 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.439498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.440319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.440702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.441135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.442187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.443714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.446445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:04.462982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1256/2503] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:04.466926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.478149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2184ba02-2bee-4fbf-82ef-faf518b16bcc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.483496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.483676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.483831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.484108 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.485983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.487105 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42d45f5-9620-4c94-bcde-17b4fa706aa9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.500411 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1248/2504] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:04.504761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.515185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d63d96-4cf4-4f59-bd40-e9090a236baa admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.520398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.521286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.521594 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.522043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] PATH_INFO: `/v3/projects/95443f94aed44e69822c8109a298a496/users/db773c456135440c97a56026ae72834f/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.538686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95443f94aed44e69822c8109a298a496, user_id=db773c456135440c97a56026ae72834f, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.541385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.641216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1257/2505] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:04 2022] PUT /identity/v3/projects/95443f94aed44e69822c8109a298a496/users/db773c456135440c97a56026ae72834f/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:04.652082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.652401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.652685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.680388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] MFA Rules not processed for user `db773c456135440c97a56026ae72834f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:04.681617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:04.747640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1249/2506] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:04.752170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.815937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e95d3-54f9-4232-b9d3-d0270822ef60 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.821188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:04.821849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:04.822137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:04.822417 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:04.823113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:04.825081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:04.944353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1258/2507] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:04.945590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:04.959894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a1a45-ff1e-4f37-8af1-e81e3cfac1e5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:04.970156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:05.029294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.029985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.030271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.030549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.031240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.033198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.120582 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1250/2508] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:04 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:05.124284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.139945 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac5519-898d-4efe-832a-ae242bda6098 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.146383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.146383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.146383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.146383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.148147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.148792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.174355 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1259/2509] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:05.180559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.189303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acbcb23-7424-48ef-8c15-c203de191f5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.198431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.199989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.199989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.200274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] PATH_INFO: `/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3/users/7fe09ff425e34dfdad47c24c7f02106d/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.217685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd86171d0ea4658880ec394ee2aa0c3, user_id=7fe09ff425e34dfdad47c24c7f02106d, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.220552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.298256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1251/2510] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:05 2022] PUT /identity/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3/users/7fe09ff425e34dfdad47c24c7f02106d/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:05.303009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.312987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc619618-9ed4-4477-8f2e-efb96612a3ae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.378659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.379342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.379684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.379969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.380759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.382483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef5e71d-f6c7-4cf6-a8f7-24ff0de6ec29 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.399792 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1260/2511] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:05.400598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.412130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835a58f-3794-4ec7-8e20-398f161188d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.417900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.418863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.419150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.419497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] PATH_INFO: `/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3/users/7fe09ff425e34dfdad47c24c7f02106d/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.421600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd86171d0ea4658880ec394ee2aa0c3, user_id=7fe09ff425e34dfdad47c24c7f02106d, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.425320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.443668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1252/2512] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:05 2022] PUT /identity/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3/users/7fe09ff425e34dfdad47c24c7f02106d/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:05.453899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.454206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.454494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.486848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] MFA Rules not processed for user `7fe09ff425e34dfdad47c24c7f02106d`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:05.488900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:05.526478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:05.571349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1261/2513] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:05.578601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.580415 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:05.647289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d66101-23e7-4ecf-859b-9c13a0493259 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.650999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.651647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.651930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.652242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.662205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:05.663651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10ea96-81ee-439e-89e2-f43145310f09 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:05.673277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1253/2514] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:05.946769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:05.957939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deba396-7b51-409f-bff3-e2e23435c9bf None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:05.962472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:05.963330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.969206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.969206 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.970864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb8ae-cb68-445f-8b20-bd1daa38ddec None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.971179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb8ae-cb68-445f-8b20-bd1daa38ddec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.971505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacb8ae-cb68-445f-8b20-bd1daa38ddec None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:05.973714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1254/2515] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:27:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:05.980852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c89d3-80f6-4f29-9fde-5eb37b39cb6e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:05.981236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c89d3-80f6-4f29-9fde-5eb37b39cb6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:05.981587 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c89d3-80f6-4f29-9fde-5eb37b39cb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:06.012925 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2d6c89d3-80f6-4f29-9fde-5eb37b39cb6e None None] MFA Rules not processed for user `f30afe81d08546e5b56ab490893ef303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:06.014127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2d6c89d3-80f6-4f29-9fde-5eb37b39cb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:06.042775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:06.044529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:06.057758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1262/2516] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:06.085733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1255/2517] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:27:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:06.100771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:06.102211 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:06.117409 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21fec0-a933-453f-a070-0f731437bc1f service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:06.121156 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:06.121802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:06.122085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:06.122359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:06.129669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:06.135698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66beecd0-33ff-4dcb-b63f-d9195a43ae1e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:06.138984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1263/2518] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:06.223085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422a5-b459-4521-844f-386dfe68723d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:06.223611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422a5-b459-4521-844f-386dfe68723d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:06.225211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422a5-b459-4521-844f-386dfe68723d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:06.225477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1256/2519] 10.222.0.33 () {54 vars in 921 bytes} [Tue Jul 12 18:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 18:27:06.231138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa927-c946-4f50-99ae-8f026babf134 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:06.231671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa927-c946-4f50-99ae-8f026babf134 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:06.232058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cfa927-c946-4f50-99ae-8f026babf134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:06.252093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-33cfa927-c946-4f50-99ae-8f026babf134 None None] MFA Rules not processed for user `50043e6bb2414d7dbf9feecd1b1980bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:06.253955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33cfa927-c946-4f50-99ae-8f026babf134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:06.326877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1264/2520] 10.222.0.33 () {58 vars in 1018 bytes} [Tue Jul 12 18:27:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:06.338078 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212422a5-b459-4521-844f-386dfe68723d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:06.349957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212422a5-b459-4521-844f-386dfe68723d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:06.355785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:06.360180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:06.360180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:06.360180 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:06.373483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:06.375217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:06.387003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1257/2521] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:10.000601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:10.001056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:10.001164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:10.018779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:10.020022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:10.061940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:10.076397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1265/2522] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:27:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:10.089280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:10.090779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:10.097454 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:10.162405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b26200-eace-47d0-9839-7c1187d17590 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:10.167499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:10.168306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:10.168589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:10.168861 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:10.178233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:10.179902 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:10.188383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1258/2523] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:27:12.900284 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:12.902358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:12.931795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9582048-bf42-47e3-999c-5eca829b5138 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:12.943099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:12.943684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:12.943972 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:12.944308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:12.946145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:12.989845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:12.991505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8343cb0-20b5-41f8-acb1-674b30c87ef0 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:13.004486 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1266/2524] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:14.746162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:14.812601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cd56f1-5b41-4070-9a84-393ad668f62f service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:14.817389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:14.818264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:14.818543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:14.818817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] PATH_INFO: `/v3/users/db773c456135440c97a56026ae72834f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:14.820005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db773c456135440c97a56026ae72834f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:14.822850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:15.026763 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db773c456135440c97a56026ae72834f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.039252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db773c456135440c97a56026ae72834f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.045867 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db773c456135440c97a56026ae72834f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.098569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db773c456135440c97a56026ae72834f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.099206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db773c456135440c97a56026ae72834f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.113729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1259/2525] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:14 2022] DELETE /identity/v3/users/db773c456135440c97a56026ae72834f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:15.118319 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:15.118759 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:15.119029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:15.138339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:15.139546 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:15.199888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1267/2526] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:15.211047 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:15.212475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:15.227646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:15.271039 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1229ef-8fac-4667-b966-18afbc0f25f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:15.274569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:15.275210 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:15.275492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:15.275833 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:15.285217 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:15.286719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:15.296895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1260/2527] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:15.820316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:15.821869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:15.833949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f6e66-9868-4fba-ba08-1d69ea64c773 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:15.838639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:15.839485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:15.844353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:15.844353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] PATH_INFO: `/v3/projects/95443f94aed44e69822c8109a298a496` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:15.844353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=95443f94aed44e69822c8109a298a496)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:15.844353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:15.949611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95443f94aed44e69822c8109a298a496', 'request_id': 'req-6fe6f30e-6f0a-4821-add6-fd8932f29baf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:15.956755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95443f94aed44e69822c8109a298a496', 'request_id': 'req-6fe6f30e-6f0a-4821-add6-fd8932f29baf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.023817 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95443f94aed44e69822c8109a298a496', 'request_id': 'req-6fe6f30e-6f0a-4821-add6-fd8932f29baf'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.035345 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] The token cache is being invalidate because project 95443f94aed44e69822c8109a298a496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:16.036300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.037240 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.038820 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1268/2528] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:15 2022] DELETE /identity/v3/projects/95443f94aed44e69822c8109a298a496 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:16.042828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:16.053999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7571e7a-86a1-46cb-af73-dd342c4922c7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:16.113292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:16.114871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:16.115158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:16.115435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] PATH_INFO: `/v3/users/7fe09ff425e34dfdad47c24c7f02106d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:16.116699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fe09ff425e34dfdad47c24c7f02106d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:16.119182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:16.312530 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fe09ff425e34dfdad47c24c7f02106d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.325181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fe09ff425e34dfdad47c24c7f02106d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.332110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fe09ff425e34dfdad47c24c7f02106d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.395465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fe09ff425e34dfdad47c24c7f02106d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.396268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63e4d84e-2ca1-4ce6-bfa5-88ed8f3ddcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fe09ff425e34dfdad47c24c7f02106d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:16.403074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1261/2529] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:16 2022] DELETE /identity/v3/users/7fe09ff425e34dfdad47c24c7f02106d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:16.808222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:16.812793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:16.826357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6f30e-6f0a-4821-add6-fd8932f29baf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:16.884660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:16.885558 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:16.885854 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:16.886136 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] PATH_INFO: `/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:16.887368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd86171d0ea4658880ec394ee2aa0c3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:16.889318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:16.890973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:16.996916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd86171d0ea4658880ec394ee2aa0c3', 'request_id': 'req-3987773f-443d-401a-a8d8-7154cf871c8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:17.003908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd86171d0ea4658880ec394ee2aa0c3', 'request_id': 'req-3987773f-443d-401a-a8d8-7154cf871c8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:17.063564 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd86171d0ea4658880ec394ee2aa0c3', 'request_id': 'req-3987773f-443d-401a-a8d8-7154cf871c8a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:17.074168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] The token cache is being invalidate because project ddd86171d0ea4658880ec394ee2aa0c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:17.074453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:17.075070 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3987773f-443d-401a-a8d8-7154cf871c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:17.076686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1269/2530] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:16 2022] DELETE /identity/v3/projects/ddd86171d0ea4658880ec394ee2aa0c3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:17.081567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.082051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.082186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.101465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:17.102687 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:17.132783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:17.163474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1262/2531] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:17.172303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.172597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.172878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.190889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:17.192094 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:17.199983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1270/2532] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:17.204136 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.214760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c4151a-1caf-477f-a1cb-1fd32b8c9c4c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.224269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.224269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.224269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.224269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.224589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:17.224589 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.225785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.241317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1263/2533] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:17.242405 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.251935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814eb306-912b-4882-8a0c-8a6561568e80 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.257415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.258082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.258376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.258714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.259425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.261492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.386392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1271/2534] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/projects => generated 407 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:17.390997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.401678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064eed9-f795-4bc7-bf80-a73a2f071bf8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.460978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.461573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.461860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.462145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.462888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.464971 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.539613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1264/2535] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/users => generated 304 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:17.543861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.555874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2f2c3-f656-4ad5-b44a-f0229737c86a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.560693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.561312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.561600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.561877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.562609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.564221 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.575045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1272/2536] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:17.578991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.589095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd5de9-edad-483a-b1da-64fc322e8712 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.593695 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.594350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.594630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.594922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.595623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.597327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a7c5a-98ba-419b-992f-9ead1fc491b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.607764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1265/2537] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:17.611790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.622813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ae406-9ed1-44bf-87d0-59921f5c0f47 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.627419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.628342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.628626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.628904 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] PATH_INFO: `/v3/projects/33d7df5923d745b3b56eef00b7196350/users/f40f31abf4384d688bfd9bf120f0a267/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.644368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d7df5923d745b3b56eef00b7196350, user_id=f40f31abf4384d688bfd9bf120f0a267, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.647797 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:17.732983 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1273/2538] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:17 2022] PUT /identity/v3/projects/33d7df5923d745b3b56eef00b7196350/users/f40f31abf4384d688bfd9bf120f0a267/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:17.743019 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.744545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.744545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.769247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] MFA Rules not processed for user `f40f31abf4384d688bfd9bf120f0a267`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:17.770986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:17.841580 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1266/2539] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:17.846089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:17.915829 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0831a0d5-368d-46f9-970a-5d2e3d3f5600 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:17.920994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:17.921687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:17.921973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:17.922251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:17.922959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:17.924948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.054026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1274/2540] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:17 2022] POST /identity/v3/projects => generated 409 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:18.059314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.069834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd361be-9df8-4509-9a02-e070644f6d02 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.098502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:18.124350 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.125004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.125286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.125562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.126246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.128156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.212697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1267/2541] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:18 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:18.216695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.227231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25979cdf-a78b-4ac6-9a4f-81e9da36b0f7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.231918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.232619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.232918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.233199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.233959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.240662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.246431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:18.252138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1275/2542] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:18.256894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.267685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8883126-6a0d-4808-813f-6c4ded4b3c2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.273355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.274274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.274557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.274829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] PATH_INFO: `/v3/projects/b7c622d72c2a4a2380b54b65500001eb/users/f473bd79189f42c2a25d3aa344b0f734/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.291169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c622d72c2a4a2380b54b65500001eb, user_id=f473bd79189f42c2a25d3aa344b0f734, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.293859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.357709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1268/2543] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:18 2022] PUT /identity/v3/projects/b7c622d72c2a4a2380b54b65500001eb/users/f473bd79189f42c2a25d3aa344b0f734/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:18.364936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.370738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cca88-9774-42c1-9fed-e773f446adb4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.430307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.431013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.431305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.435752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.435752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.435752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f98c60-8f86-4404-a747-7ad81d293449 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.448936 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1276/2544] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:18.452733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.463339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05098921-4f3d-4c97-908a-0720c0bf3c44 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.467961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.469009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.469297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.469569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] PATH_INFO: `/v3/projects/b7c622d72c2a4a2380b54b65500001eb/users/f473bd79189f42c2a25d3aa344b0f734/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.471676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7c622d72c2a4a2380b54b65500001eb, user_id=f473bd79189f42c2a25d3aa344b0f734, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.474872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.485237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1269/2545] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:18 2022] PUT /identity/v3/projects/b7c622d72c2a4a2380b54b65500001eb/users/f473bd79189f42c2a25d3aa344b0f734/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:18.496461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.501364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.501364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.523341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] MFA Rules not processed for user `f473bd79189f42c2a25d3aa344b0f734`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:18.524601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:18.594018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1277/2546] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:18.604737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:18.606364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:18.673768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a18e8-f52d-4a20-8a6b-683048903cce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:18.678979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:18.679657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:18.679948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:18.680261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:18.689653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:18.691073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:18.701620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1270/2547] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:19.003737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:19.013291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009c78e-7e9f-4b38-a65f-a179aca13164 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:19.016912 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:19.017550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:19.017865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:19.018148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:19.076814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:19.078263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:19.087196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1278/2548] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:19.801980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:19.803456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:19.860638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73926ec-af51-4d15-903f-d35a9bc6b8d5 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:19.864531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:19.865192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:19.865476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:19.865754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:19.867574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:19.908430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:19.931817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:19.933298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:19.943154 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1271/2549] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:23.875847 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:23.877381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:23.895368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baab4b12-ecd8-4a2e-904f-84f884454ff0 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:23.900183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:23.901066 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:23.901353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:23.901634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] PATH_INFO: `/v3/users/d1e1edac4a2f430ea534bf4911988d45` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:23.902846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1e1edac4a2f430ea534bf4911988d45)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:23.904824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:23.920243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:24.111082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1e1edac4a2f430ea534bf4911988d45'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.123118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1e1edac4a2f430ea534bf4911988d45'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.130956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1e1edac4a2f430ea534bf4911988d45'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.178774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1e1edac4a2f430ea534bf4911988d45'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.179432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-10f7be38-f7b4-4402-b180-ada419cb31cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1e1edac4a2f430ea534bf4911988d45'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.186560 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1279/2550] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:23 2022] DELETE /identity/v3/users/d1e1edac4a2f430ea534bf4911988d45 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:24.396860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:24.407745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5986bd7-a8ff-4e65-b5b8-02a5a83c317e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:24.465832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:24.466690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.466967 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.467235 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] PATH_INFO: `/v3/projects/63290439e70e483987c4087addcd4ea7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.468422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] RBAC: Authorizing `identity:delete_project(project_id=63290439e70e483987c4087addcd4ea7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:24.470349 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:24.567804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63290439e70e483987c4087addcd4ea7', 'request_id': 'req-f642f5ff-b867-4496-83b9-c927cec5027e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.573917 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63290439e70e483987c4087addcd4ea7', 'request_id': 'req-f642f5ff-b867-4496-83b9-c927cec5027e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.651758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63290439e70e483987c4087addcd4ea7', 'request_id': 'req-f642f5ff-b867-4496-83b9-c927cec5027e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.662781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] The token cache is being invalidate because project 63290439e70e483987c4087addcd4ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:24.663063 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.663692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f642f5ff-b867-4496-83b9-c927cec5027e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:24.665242 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1272/2551] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:24 2022] DELETE /identity/v3/projects/63290439e70e483987c4087addcd4ea7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:24.670198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.670495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.670780 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.687921 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:24.689147 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:24.746470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1280/2552] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:24.754799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.755095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.755378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.773816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:24.775015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:24.782869 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1273/2553] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:24.787522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:24.797026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c298c-154a-46b9-af6b-82b3e1ac8404 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:24.801576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:24.802225 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.802536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.802818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.803544 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:24.803872 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:24.805473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:24.817449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1281/2554] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:24.822408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:24.832152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f2efc-e7fd-4045-9ac6-5d214bcc0374 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:24.837295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:24.837932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.838213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.838486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.839430 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:24.841351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:24.921959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1274/2555] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:24 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:24.926263 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:24.937165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3fe74-bbf9-471a-ac09-a25ea9b1be05 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:24.993364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:24.994060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:24.994340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:24.994614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:24.995293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:24.997260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.075026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1282/2556] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:24 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:25.079236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.089457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909151a9-2f6b-4d1a-85d3-fc22d0bd7ce1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.094129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.094772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.095055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.095333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.096213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.098117 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.108864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1275/2557] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:25.112852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.123478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32295cf7-ad06-4799-b876-a5b3a13d22d2 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.127968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.128648 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.128931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.129208 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.129929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.131507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a393d-93da-49c3-9793-1a3afe026dbb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.133484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:25.142229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1283/2558] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:25.147310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.157383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ebc78-38d4-4800-bac5-75c61d468ad3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.162887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.163750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.164029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.164332 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] PATH_INFO: `/v3/projects/bd9960494f614a08b26c4aeb7f63ded2/users/9a142a7e080c494b88a036422e29b8ad/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.178467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9960494f614a08b26c4aeb7f63ded2, user_id=9a142a7e080c494b88a036422e29b8ad, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.181141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.263742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1276/2559] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:25 2022] PUT /identity/v3/projects/bd9960494f614a08b26c4aeb7f63ded2/users/9a142a7e080c494b88a036422e29b8ad/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:25.280646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.280934 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.281212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.307571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] MFA Rules not processed for user `9a142a7e080c494b88a036422e29b8ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:25.308919 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:25.372561 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1284/2560] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:25.377093 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.381736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:25.442026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce7ef8-b777-4760-9e5d-ff69e8698bfd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.447164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.447913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.448320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.448673 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.449431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.451428 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.546532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1277/2561] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:25 2022] POST /identity/v3/projects => generated 387 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:25.550802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.563426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55801424-4f68-40b8-bb85-18cfec6b1f69 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.632165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.632884 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.633828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.633983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:25.634466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.634901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.635747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.638035 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.648392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae3afe-4080-4970-99fe-3cb9acbcc33c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.653819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.654704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.654986 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.658393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] PATH_INFO: `/v3/users/f40f31abf4384d688bfd9bf120f0a267` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.658393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f40f31abf4384d688bfd9bf120f0a267)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.658585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.727090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1285/2562] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:25 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:25.731161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.740503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d7da64-97f0-4e97-8eb7-61a8edc713dd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.745146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.745786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.746093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.746354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.747069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.748685 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.759006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1286/2563] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:25.762763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.772946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8502e-6844-4fe9-9d4c-5332afc7a718 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.777611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.778245 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.778538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.778827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.779537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.781124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.791662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1287/2564] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:25.795449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:25.804795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb339b05-af88-4765-9ff8-dbac5c17aa90 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:25.809444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:25.814113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.814113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.814113 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] PATH_INFO: `/v3/projects/1b0a0bd1aab8414580f91ed9d4c580e3/users/6ee2c2803da34b199362d40f336bd196/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.828979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0a0bd1aab8414580f91ed9d4c580e3, user_id=6ee2c2803da34b199362d40f336bd196, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:25.831609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483804b0-122a-4829-b11a-1a90d70905ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:25.845051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f40f31abf4384d688bfd9bf120f0a267'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:25.856593 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f40f31abf4384d688bfd9bf120f0a267'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:25.863526 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f40f31abf4384d688bfd9bf120f0a267'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:25.944314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1288/2565] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:25 2022] PUT /identity/v3/projects/1b0a0bd1aab8414580f91ed9d4c580e3/users/6ee2c2803da34b199362d40f336bd196/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:25.954174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.954467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.954750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.960160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f40f31abf4384d688bfd9bf120f0a267'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:25.960809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e41b8ed-ffc0-49db-af85-0548694c6e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f40f31abf4384d688bfd9bf120f0a267'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:25.967459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1278/2566] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:25 2022] DELETE /identity/v3/users/f40f31abf4384d688bfd9bf120f0a267 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:25.971755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:25.972052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:25.972384 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:25.983617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] MFA Rules not processed for user `6ee2c2803da34b199362d40f336bd196`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:25.984883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:25.988929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:25.990626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.003480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.040821 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.048812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1279/2567] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:26.051106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1289/2568] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:26.055974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.057376 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.059510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.060909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.070102 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932d2ae-5d2a-4228-83e1-6970f2ded443 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.074897 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.075592 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.075880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.076187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.076883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.078783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.118139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb681ef1-cf9f-46db-a8e1-2d40ec13830c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.121732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.122373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.122654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.122929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.132511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.133922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.143253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1290/2569] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:26.174579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1280/2570] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:26 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:26.179600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.189226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bd7b0-93f1-49a1-8ccb-6e9fd7a75919 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.247646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.248366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.248658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.248980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.249650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.251651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.339215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1291/2571] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:26 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:26.343361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.356499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcae10-12fa-433c-8976-0d52992c2f91 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.365657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.365657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.365657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.365657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.366004 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.366099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.381449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1281/2572] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:26.382707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.393326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754c3f-995e-4cc3-907b-54005a64b9f3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.398069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.399169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.399471 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.399743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] PATH_INFO: `/v3/projects/c56b000a2d484e148d45e18bc96f309c/users/aabdb9bbefe344a8a7fd92798e7d8610/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.415747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56b000a2d484e148d45e18bc96f309c, user_id=aabdb9bbefe344a8a7fd92798e7d8610, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.418499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.545191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1292/2573] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:26 2022] PUT /identity/v3/projects/c56b000a2d484e148d45e18bc96f309c/users/aabdb9bbefe344a8a7fd92798e7d8610/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:26.549168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.559924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613549c0-d6f4-4a7d-b712-6b07e0641152 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.579293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.581891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.618139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.629970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.630671 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.630955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.631230 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.631955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.633591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.643410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1282/2574] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:26.648256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.652785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e150a158-b798-4376-a74d-2cf4bd2ae2ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.657597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.662888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ccda4-93db-4e16-907b-50b6c99a8b67 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.663006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.663006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.663006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] PATH_INFO: `/v3/projects/33d7df5923d745b3b56eef00b7196350` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.663006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d7df5923d745b3b56eef00b7196350)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.663006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.664069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.665296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.665583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.665866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] PATH_INFO: `/v3/projects/c56b000a2d484e148d45e18bc96f309c/users/aabdb9bbefe344a8a7fd92798e7d8610/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.668012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c56b000a2d484e148d45e18bc96f309c, user_id=aabdb9bbefe344a8a7fd92798e7d8610, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.670707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a56cd-b05c-4b11-a85c-e4a9c34f6ce7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.682141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1283/2575] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:26 2022] PUT /identity/v3/projects/c56b000a2d484e148d45e18bc96f309c/users/aabdb9bbefe344a8a7fd92798e7d8610/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:26.692204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.692501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.692783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.719542 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] MFA Rules not processed for user `aabdb9bbefe344a8a7fd92798e7d8610`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:26.720900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.750747 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d7df5923d745b3b56eef00b7196350', 'request_id': 'req-ef2051c4-686a-4682-9979-a1f0d905f7b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:26.757323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d7df5923d745b3b56eef00b7196350', 'request_id': 'req-ef2051c4-686a-4682-9979-a1f0d905f7b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:26.789449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1284/2576] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:26.800442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.800675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d7df5923d745b3b56eef00b7196350', 'request_id': 'req-ef2051c4-686a-4682-9979-a1f0d905f7b9'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:26.801774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.819260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] The token cache is being invalidate because project 33d7df5923d745b3b56eef00b7196350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:26.819552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:26.820283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:26.821874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1293/2577] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:26 2022] DELETE /identity/v3/projects/33d7df5923d745b3b56eef00b7196350 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:26.825810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:26.827209 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.847371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:26.864313 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1baf7-6aa5-4299-9344-3cf4c6e92da7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.891811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2051c4-686a-4682-9979-a1f0d905f7b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:26.897170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.898032 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.898312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.898587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] PATH_INFO: `/v3/users/f473bd79189f42c2a25d3aa344b0f734` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.899793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f473bd79189f42c2a25d3aa344b0f734)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.902057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.914375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:26.915027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:26.915319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:26.915602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:26.917437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:26.981723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:26.983174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:26.992699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1285/2578] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:27.100892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f473bd79189f42c2a25d3aa344b0f734'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.111008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:27.113219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f473bd79189f42c2a25d3aa344b0f734'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.120006 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f473bd79189f42c2a25d3aa344b0f734'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.201914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f473bd79189f42c2a25d3aa344b0f734'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.202604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1bf9e1c5-2202-4b6d-9f0c-f3d1ab99616d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f473bd79189f42c2a25d3aa344b0f734'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.209911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1294/2579] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:26 2022] DELETE /identity/v3/users/f473bd79189f42c2a25d3aa344b0f734 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:27.588598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:27.600377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3658e46-01bf-4e3f-8308-4891c0c24ea0 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:27.656697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:27.657559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:27.657846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:27.658130 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] PATH_INFO: `/v3/projects/b7c622d72c2a4a2380b54b65500001eb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:27.659300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7c622d72c2a4a2380b54b65500001eb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:27.661261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:27.768468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:27.772653 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7c622d72c2a4a2380b54b65500001eb', 'request_id': 'req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.778670 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7c622d72c2a4a2380b54b65500001eb', 'request_id': 'req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.892149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7c622d72c2a4a2380b54b65500001eb', 'request_id': 'req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.904347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] The token cache is being invalidate because project b7c622d72c2a4a2380b54b65500001eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:27.904640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.905294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6626632f-efeb-4ec7-b98e-bb4042ddc1eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:27.906888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1286/2580] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:27 2022] DELETE /identity/v3/projects/b7c622d72c2a4a2380b54b65500001eb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:27.913480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:27.913770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:27.914142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:27.934335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:27.936099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.005933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1295/2581] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:28.013960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.014254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.014535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.035771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:28.037954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.045941 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1287/2582] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:28.050243 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.060601 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62db0a6-5a8d-49b1-892e-d4c85259ac23 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.065026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.065681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.065964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.066238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.066964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:28.067271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.069011 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.077457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.078929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.081714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1296/2583] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:28.085731 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.095707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86db1be-c03f-49c6-8222-72d4d32c5300 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.101130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.101786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.102057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.102477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.103131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.105086 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.136980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019360-7f9e-4a72-8a61-6cc0d1a43416 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.140609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.141244 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.141525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.141798 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.143655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.199767 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1297/2584] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:28.201085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.201556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.203033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.212895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1288/2585] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:28.270168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827f1c-2410-4413-a0f5-153242ef2ed3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.275617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.276432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.276793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.277140 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.277994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.284277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.401857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1298/2586] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:28 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:28.405930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.417495 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73f384-c1aa-49f6-b076-8ec36d804fe1 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.421921 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.422611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.422895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.423167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.428263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.428263 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.438823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1289/2587] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:28.440096 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.450204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c411f45e-7e6d-4bba-96f4-6cea1c3070c3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.454964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.455625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.455915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.456226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.457039 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.459137 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988da715-4ac6-4e13-8615-e2f9b91228d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.468959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1299/2588] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:28.473013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.483719 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f38121-49e4-42b4-abb9-9637d1dcd501 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.488310 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.489188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.489470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.489744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] PATH_INFO: `/v3/projects/c5a8a7302257426791eb72acfcad756d/users/f2b54b3ff8934e67aef81cea85e16f57/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.504746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a8a7302257426791eb72acfcad756d, user_id=f2b54b3ff8934e67aef81cea85e16f57, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.508250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.575735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1290/2589] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:28 2022] PUT /identity/v3/projects/c5a8a7302257426791eb72acfcad756d/users/f2b54b3ff8934e67aef81cea85e16f57/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:28.586589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.586961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.587317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.615737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] MFA Rules not processed for user `f2b54b3ff8934e67aef81cea85e16f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:28.617043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.626412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:28.682786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1300/2590] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:28.694667 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:28.700236 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:28.741946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:28.752460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907dc51a-3d72-4181-859d-c4eef1af10cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:28.756590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:28.757233 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:28.757514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:28.757787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:28.767311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:28.768915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:28.778701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1291/2591] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:32.993224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:33.002954 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5716fce-72e1-443d-a351-f7a1f48410b1 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:33.007308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:33.007965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:33.008509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:33.008981 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:33.011271 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:33.073525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:33.075828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f014288-ec56-4791-a783-cb0b43980b61 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:33.086082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1301/2592] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:35.663346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:35.728944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06aa84-b508-4cb3-9dd7-94dcc15c131f service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:35.733379 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:35.734237 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:35.734523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:35.734799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] PATH_INFO: `/v3/users/f2b54b3ff8934e67aef81cea85e16f57` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:35.735976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b54b3ff8934e67aef81cea85e16f57)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:35.737942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:35.951179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b54b3ff8934e67aef81cea85e16f57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:35.962762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b54b3ff8934e67aef81cea85e16f57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:35.969455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b54b3ff8934e67aef81cea85e16f57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.086447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b54b3ff8934e67aef81cea85e16f57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.087059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b54b3ff8934e67aef81cea85e16f57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.093493 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1292/2593] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:35 2022] DELETE /identity/v3/users/f2b54b3ff8934e67aef81cea85e16f57 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:36.098001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:36.098490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:36.098615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:36.116867 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:36.118058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:36.176991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1302/2594] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:36.187095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:36.188682 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:36.246374 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c28c9a6-6f48-4b13-aaab-2b55e7cb7e11 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:36.249847 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:36.250485 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:36.250769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:36.251048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:36.259891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:36.261340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f0b77-4e62-4f0b-a6f3-8d303bdadb16 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:36.270550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1293/2595] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:36.665660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:36.667122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:36.681657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967608e-b036-4ec6-9966-dbe864ad4508 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:36.686458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:36.687331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:36.687614 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:36.687885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] PATH_INFO: `/v3/projects/c5a8a7302257426791eb72acfcad756d` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:36.689099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a8a7302257426791eb72acfcad756d)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:36.691018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:36.809415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:36.812076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a8a7302257426791eb72acfcad756d', 'request_id': 'req-b7f756fb-27ae-48ef-8a15-e101cf438dfb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.819368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a8a7302257426791eb72acfcad756d', 'request_id': 'req-b7f756fb-27ae-48ef-8a15-e101cf438dfb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.909752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a8a7302257426791eb72acfcad756d', 'request_id': 'req-b7f756fb-27ae-48ef-8a15-e101cf438dfb'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.921079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] The token cache is being invalidate because project c5a8a7302257426791eb72acfcad756d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:36.921373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.922003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b7f756fb-27ae-48ef-8a15-e101cf438dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:36.923566 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1303/2596] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:36 2022] DELETE /identity/v3/projects/c5a8a7302257426791eb72acfcad756d => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:36.928456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:36.928888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:36.929030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:36.946631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:36.947976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:36.952156 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:37.007096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1294/2597] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:37.069181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.069393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.069657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.088436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:37.090281 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.097379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1304/2598] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:37.101538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.110991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150d18a-0033-4def-8ef0-977c6dc569b1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.115479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.116169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.116462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.116735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.117460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:37.117761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.119369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.131559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1295/2599] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:37.135760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.144953 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935713-0fc7-4731-a8ac-f9ed2fdeac95 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.150110 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.150760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.151045 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.151321 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.152009 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.153923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.235727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1305/2600] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:37 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:37.240544 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.250535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1dbb0-9984-4a84-977d-06938ba43311 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.308858 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.310708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.310708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.310708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.311119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.312870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.331647 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.335205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.345819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33179b3e-8f26-4b12-ae4b-12ae9f94609d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.350413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.351270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.351552 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.351827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] PATH_INFO: `/v3/users/9a142a7e080c494b88a036422e29b8ad` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.353041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a142a7e080c494b88a036422e29b8ad)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.354996 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.394966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1296/2601] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:37 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:37.399207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.408654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458089e4-52c7-4bf3-89cc-5f3d5aaaa3dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.413785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.414456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.414747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.415027 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.415751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.417390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.427909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1297/2602] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:37.431609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.440882 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573b8b8-0623-41e4-a4e0-1b6b0f892d54 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.446081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.454792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.454792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.454792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.454792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.454792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.460056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1298/2603] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:37.463772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.473025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197fed1-b87c-41ff-9233-6a2ebea77b8e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.477622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.478473 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.489348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.489348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] PATH_INFO: `/v3/projects/da80da5fff4247a6b3d9692b9eb80054/users/01e9412dcb67462791843188fb64026a/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.493881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da80da5fff4247a6b3d9692b9eb80054, user_id=01e9412dcb67462791843188fb64026a, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.496590 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e455327-4be1-4ca5-a252-7e5c9d5260c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.591115 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a142a7e080c494b88a036422e29b8ad'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:37.600720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1299/2604] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:37 2022] PUT /identity/v3/projects/da80da5fff4247a6b3d9692b9eb80054/users/01e9412dcb67462791843188fb64026a/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:37.603866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a142a7e080c494b88a036422e29b8ad'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:37.610610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.611083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.611332 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a142a7e080c494b88a036422e29b8ad'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:37.611451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.637287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] MFA Rules not processed for user `01e9412dcb67462791843188fb64026a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:37.638489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.666864 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:37.686463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a142a7e080c494b88a036422e29b8ad'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:37.687233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-ac59a73f-a53b-4d78-9cf7-c960edd290c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a142a7e080c494b88a036422e29b8ad'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:37.694305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1306/2605] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:37 2022] DELETE /identity/v3/users/9a142a7e080c494b88a036422e29b8ad => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:37.698695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.698991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.699279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.701399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1300/2606] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:37.712938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.714327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.717176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:37.718353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.772754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449927e-1fd4-40d8-96a4-eba9acfc9afd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.778540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1307/2607] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:37.788959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:37.790294 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:37.813217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:37.824048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.830029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.830029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.830029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.852702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67387fb4-8f7b-43c1-ab71-f4bf4b08eb4c None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:37.856042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:37.856757 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:37.857046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:37.857327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:37.868976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.870459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.880079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1308/2608] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:37.884453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:37.886067 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:37.895229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1301/2609] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:38.265160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:38.268421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:38.281845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ab04f-cf03-4f8a-b201-57623278e70a service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:38.286187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:38.287905 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:38.288149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:38.288432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] PATH_INFO: `/v3/projects/bd9960494f614a08b26c4aeb7f63ded2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:38.290272 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9960494f614a08b26c4aeb7f63ded2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:38.292176 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:38.386159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9960494f614a08b26c4aeb7f63ded2', 'request_id': 'req-6605cdc1-193f-4d5e-af6a-22345a94b019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.392440 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9960494f614a08b26c4aeb7f63ded2', 'request_id': 'req-6605cdc1-193f-4d5e-af6a-22345a94b019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.480060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9960494f614a08b26c4aeb7f63ded2', 'request_id': 'req-6605cdc1-193f-4d5e-af6a-22345a94b019'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.491378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] The token cache is being invalidate because project bd9960494f614a08b26c4aeb7f63ded2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:38.491663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.492322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.493870 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1309/2610] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:38 2022] DELETE /identity/v3/projects/bd9960494f614a08b26c4aeb7f63ded2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:38.497805 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:38.508531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbdbc67-5681-425c-b217-032f3827535a service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:38.546096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:38.572974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:38.573850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:38.574134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:38.574410 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] PATH_INFO: `/v3/users/6ee2c2803da34b199362d40f336bd196` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:38.575588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee2c2803da34b199362d40f336bd196)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:38.577543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:38.728459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee2c2803da34b199362d40f336bd196'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.740776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee2c2803da34b199362d40f336bd196'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.747535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee2c2803da34b199362d40f336bd196'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.811910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee2c2803da34b199362d40f336bd196'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.812961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee2c2803da34b199362d40f336bd196'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:38.819969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1302/2611] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:38 2022] DELETE /identity/v3/users/6ee2c2803da34b199362d40f336bd196 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:39.236191 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:39.237653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:39.251390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6605cdc1-193f-4d5e-af6a-22345a94b019 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:39.309813 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:39.310660 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:39.310942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:39.311215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] PATH_INFO: `/v3/projects/1b0a0bd1aab8414580f91ed9d4c580e3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:39.312414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0a0bd1aab8414580f91ed9d4c580e3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:39.314338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:39.393041 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:39.395900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0a0bd1aab8414580f91ed9d4c580e3', 'request_id': 'req-8b06cd02-e87e-4fc6-b755-5fc088213624'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.402586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0a0bd1aab8414580f91ed9d4c580e3', 'request_id': 'req-8b06cd02-e87e-4fc6-b755-5fc088213624'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.451756 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0a0bd1aab8414580f91ed9d4c580e3', 'request_id': 'req-8b06cd02-e87e-4fc6-b755-5fc088213624'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.462924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] The token cache is being invalidate because project 1b0a0bd1aab8414580f91ed9d4c580e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:39.463248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.463837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.465400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1310/2612] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:39 2022] DELETE /identity/v3/projects/1b0a0bd1aab8414580f91ed9d4c580e3 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:39.469438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:39.470823 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:39.483435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f6f28-8be5-4d5b-9b31-d12c600c16c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:39.539817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:39.540718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:39.541001 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:39.541276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] PATH_INFO: `/v3/users/aabdb9bbefe344a8a7fd92798e7d8610` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:39.542447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aabdb9bbefe344a8a7fd92798e7d8610)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:39.544416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:39.751674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aabdb9bbefe344a8a7fd92798e7d8610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.762071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:39.764212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aabdb9bbefe344a8a7fd92798e7d8610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.771438 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aabdb9bbefe344a8a7fd92798e7d8610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.847312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aabdb9bbefe344a8a7fd92798e7d8610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.848005 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-592670e6-d5b2-49cb-8074-d3aff04a05e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aabdb9bbefe344a8a7fd92798e7d8610'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:39.854745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1303/2613] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:39 2022] DELETE /identity/v3/users/aabdb9bbefe344a8a7fd92798e7d8610 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:40.226382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.228285 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.244539 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06cd02-e87e-4fc6-b755-5fc088213624 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.302476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.303336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.306412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.306412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] PATH_INFO: `/v3/projects/c56b000a2d484e148d45e18bc96f309c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.306412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c56b000a2d484e148d45e18bc96f309c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.307306 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.434490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c56b000a2d484e148d45e18bc96f309c', 'request_id': 'req-43866402-20c8-4ccd-a172-33ddc704afbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:40.440627 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c56b000a2d484e148d45e18bc96f309c', 'request_id': 'req-43866402-20c8-4ccd-a172-33ddc704afbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:40.526407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c56b000a2d484e148d45e18bc96f309c', 'request_id': 'req-43866402-20c8-4ccd-a172-33ddc704afbc'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:40.537480 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] The token cache is being invalidate because project c56b000a2d484e148d45e18bc96f309c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:40.537787 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:40.538426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-43866402-20c8-4ccd-a172-33ddc704afbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:40.539973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1311/2614] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:40 2022] DELETE /identity/v3/projects/c56b000a2d484e148d45e18bc96f309c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:40.547026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.547489 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.547607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.564788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.565930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.623565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1304/2615] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.632495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.632789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.633071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.651984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:40.653242 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:40.661196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1312/2616] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:40.665640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.675178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed807a-6e5a-4417-93cf-12a5b014f086 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.679708 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.680385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.680672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.680947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.681666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:40.681974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.683581 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.695308 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1305/2617] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:40.699607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.708729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba4b3c-d7f7-44c9-8e03-e7489dba7c11 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.714244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.714892 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.715182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.715463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.716172 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.718055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.779276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1313/2618] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.783353 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.793646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17494b6a-293e-418d-8822-1018cef39d34 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.849506 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.850176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.850468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.850751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.851446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.853420 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.952863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1306/2619] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:40 2022] POST /identity/v3/users => generated 292 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:40.954046 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.964764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4668fc-8618-49ee-8804-1341b58871d5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:40.969686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:40.970360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:40.970675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:40.971022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:40.971679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:40.973303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:40.983861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1314/2620] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:40.987774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:40.998504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d37c-86d8-4843-a4ff-3219a2eb6d54 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.003168 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.003819 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.004099 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.004402 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.005251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.007444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fe615-af7b-4dd5-acd3-14cecc1ba702 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.017225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1307/2621] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.021214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.031928 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91654cec-39f1-4e0e-86fa-c93a5fc018d3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.036588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.037736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.038783 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.039098 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] PATH_INFO: `/v3/projects/75ff5e7a76af43648aeb496621d8d547/users/3ad422154a9b4dc2b207eb67ae0d12ad/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.053543 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75ff5e7a76af43648aeb496621d8d547, user_id=3ad422154a9b4dc2b207eb67ae0d12ad, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.056219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.093720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.098616 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1315/2622] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:41 2022] PUT /identity/v3/projects/75ff5e7a76af43648aeb496621d8d547/users/3ad422154a9b4dc2b207eb67ae0d12ad/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:41.110733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.111024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.111440 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.137352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] MFA Rules not processed for user `3ad422154a9b4dc2b207eb67ae0d12ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:41.138598 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:41.173212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.204055 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1308/2623] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:41.208589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.273975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ce3d7-0441-418d-b659-55f0f6c36c12 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.278649 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.279311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.279626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.279906 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.280640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.282519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.378412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1316/2624] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.383036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.393608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716fd01-32e5-4ffd-a14d-d63ca60f2793 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.448886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.449549 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.449831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.450107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.450796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.452741 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.566248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1309/2625] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:41.570802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.581157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2cbc-e14a-4ab7-9d6d-63b179361b9a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.586412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.587079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.587371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.587653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.588501 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.590181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.601000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1317/2626] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.604996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.614914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bc871-da06-47f7-9e76-26ab03617e74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.620006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.620981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.621267 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.621545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] PATH_INFO: `/v3/projects/2d8c9534ae814d9392814d787599dc24/users/7e0cf582184344d1b7bbede788c4c922/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.637423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8c9534ae814d9392814d787599dc24, user_id=7e0cf582184344d1b7bbede788c4c922, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.639260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.708385 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1310/2627] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:41 2022] PUT /identity/v3/projects/2d8c9534ae814d9392814d787599dc24/users/7e0cf582184344d1b7bbede788c4c922/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:41.713185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.723931 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd350e31-9d8c-4ea4-851e-3bf63f5353d8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.778623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.779312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.779596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.779874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.780632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.782251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829877ff-a163-48e7-b849-b7faea6694dd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.792260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1318/2628] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:41.801081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.812162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b197c1-5cdb-4472-bafe-bbab0dcc4fb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:41.817933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:41.818849 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.819677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.819991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] PATH_INFO: `/v3/projects/2d8c9534ae814d9392814d787599dc24/users/7e0cf582184344d1b7bbede788c4c922/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.822033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8c9534ae814d9392814d787599dc24, user_id=7e0cf582184344d1b7bbede788c4c922, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:41.824726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:41.835070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1311/2629] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:41 2022] PUT /identity/v3/projects/2d8c9534ae814d9392814d787599dc24/users/7e0cf582184344d1b7bbede788c4c922/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:41.846026 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:41.846324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:41.846628 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:41.873340 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] MFA Rules not processed for user `7e0cf582184344d1b7bbede788c4c922`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:41.874532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:41.932916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:41.941322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1319/2630] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:41.952930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:41.954728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:42.010503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9368cf-f004-4dcd-883f-d57b24e325b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:42.014132 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:42.014768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:42.015054 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:42.015331 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:42.055575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:42.070894 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:42.072679 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527f2cf-0072-4583-8afc-60fc344a6f55 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:42.081253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1312/2631] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:43.536187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:43.538457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:43.628597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd05f5-74d7-451d-b9fa-b8da1a40401b None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:43.634669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:43.635733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.636075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.636455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] PATH_INFO: `/v3/users/01e9412dcb67462791843188fb64026a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.637810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e9412dcb67462791843188fb64026a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:43.639937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:43.829216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e9412dcb67462791843188fb64026a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:43.841589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e9412dcb67462791843188fb64026a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:43.849188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e9412dcb67462791843188fb64026a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:43.955810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e9412dcb67462791843188fb64026a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:43.956610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e9412dcb67462791843188fb64026a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:43.964891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1320/2632] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:43 2022] DELETE /identity/v3/users/01e9412dcb67462791843188fb64026a => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:43.969280 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:43.969766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:43.969883 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:43.987322 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:43.988626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.065419 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1313/2633] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:44.071837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.073258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.133105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b96a2-b114-45ff-885a-a88fb224debe admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.136581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.137230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.137514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.137788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.148754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.149584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1753a-44c4-49d5-be5b-5d5bcbb4ce49 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:44.159639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1321/2634] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:44.567871 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.569363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.584251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766d1e3-32b7-4654-9a24-cd685fadb979 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.590522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.591382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.591796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.592006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] PATH_INFO: `/v3/projects/da80da5fff4247a6b3d9692b9eb80054` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.593257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da80da5fff4247a6b3d9692b9eb80054)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.595211 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:44.709651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da80da5fff4247a6b3d9692b9eb80054', 'request_id': 'req-9e248a52-f03c-446d-94f8-6648c3770ef2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:44.716270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da80da5fff4247a6b3d9692b9eb80054', 'request_id': 'req-9e248a52-f03c-446d-94f8-6648c3770ef2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:44.777926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da80da5fff4247a6b3d9692b9eb80054', 'request_id': 'req-9e248a52-f03c-446d-94f8-6648c3770ef2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:44.788744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] The token cache is being invalidate because project da80da5fff4247a6b3d9692b9eb80054 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:44.789644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:44.790268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e248a52-f03c-446d-94f8-6648c3770ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:44.793094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1314/2635] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:44 2022] DELETE /identity/v3/projects/da80da5fff4247a6b3d9692b9eb80054 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:44.796720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.797217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.797314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.814728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:44.815859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.828725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:44.876069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1322/2636] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:44.883605 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.883900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.884215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.905074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:44.906279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:44.915336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1315/2637] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:44.919456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.928887 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84a32a-52ba-48ad-a61b-eb5066a14d06 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.933368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.934014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.934296 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.934569 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.935282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:44.935584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.937250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:44.948602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1323/2638] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:44.954656 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:44.962774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9eec068-ae60-40c2-8fa8-8d0f2b89a8e0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:44.967457 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:44.968152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:44.968441 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:44.968716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:44.969400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:44.971364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.087850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1316/2639] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:44 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:45.091796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.101745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09dac2-0c61-4e89-8138-7ab24aeb09b9 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.157233 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.158048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.158431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.158833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.159622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.161571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.278621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1324/2640] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:45 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:45.279866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.290480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e8912-fa68-4f07-8e5b-9728c4fa68d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.295188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.296316 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.296727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.297012 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.297773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.299481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.310444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1317/2641] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:45.314311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.325615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae3df9-134f-4a1a-9aab-50d6183b5bfd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.330412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.331088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.331378 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.331663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.332431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.334038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2cbbc-7c8c-469a-99de-efeb32b7b30d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.345559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1325/2642] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:45.349472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.364292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1e8f9-aa9d-4958-80ec-71a388edc5a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.376645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.377731 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.378110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.378486 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] PATH_INFO: `/v3/projects/15a3f3bc344441d086cac7d86c4da123/users/f854a7c1e5a94725945a9fef455ce443/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.407175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15a3f3bc344441d086cac7d86c4da123, user_id=f854a7c1e5a94725945a9fef455ce443, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.410111 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.512155 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:45.517575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1318/2643] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:45 2022] PUT /identity/v3/projects/15a3f3bc344441d086cac7d86c4da123/users/f854a7c1e5a94725945a9fef455ce443/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:45.522625 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.522932 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.523241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.542202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:45.543420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:45.606773 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1326/2644] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:45.617399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:45.619124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:45.690286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b25fb-d4f8-40f1-9f69-6ee8373034c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:45.694277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:45.694963 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:45.695940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:45.696261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:45.705947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:45.707382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:45.718181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1319/2645] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:47.122623 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:47.124314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:47.155107 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:47.195959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a617f-5fe2-4cf3-bd44-33730e24fd82 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:47.200760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:47.204873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:47.204873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:47.204873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:47.204873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:47.279969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:47.281534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a098aa7-6fb6-4291-9e07-25214a0b0f42 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:47.292692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1327/2646] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:51.619771 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.629652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090315c-538b-4ca5-a8d2-69cadd4fcb80 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.645608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.645608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.645608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.645608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.649945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:51.650055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.650055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.650055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.656845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.658297 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.670062 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1320/2647] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:51.678001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] MFA Rules not processed for user `f854a7c1e5a94725945a9fef455ce443`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:51.679356 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:51.754483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1328/2648] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:51.759545 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.771363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768be9f3-9639-4619-a760-3bd0274c672b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.776812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.777674 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.777961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.778238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.779030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.780994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.871429 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1321/2649] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:51 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:51.875473 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:51.886909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b839dd-f066-442a-8404-aab0bb300349 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:51.948462 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:51.949268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:51.949650 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:51.950023 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:51.950814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:51.952918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:51.962812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:52.055668 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1329/2650] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:51 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:52.056994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.067596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcbe14-b754-4f4b-be2a-84654114316a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.073174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.073978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.074444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.074813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.075615 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.077509 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.097030 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1322/2651] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:52.098837 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.114568 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc936166-c059-4353-b3d7-68b88259550d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.125977 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.128042 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.128618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.129112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] PATH_INFO: `/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e/users/5ca442117e344ba4ab15daf1f0b05855/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.151991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c2a07c33e944bc966f8ab2434f5f3e, user_id=5ca442117e344ba4ab15daf1f0b05855, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.154876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.260874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1330/2652] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:52 2022] PUT /identity/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e/users/5ca442117e344ba4ab15daf1f0b05855/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:52.264477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.275758 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0378f1a-11f2-446e-b080-7febcd45946e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.400884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.402223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.402345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.403142 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.403978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.406579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.423556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1323/2653] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:52.424781 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:52.443139 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6104dd-b6fd-4412-a518-60b039d34cae admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:52.454535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:52.455575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:52.455976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:52.456322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] PATH_INFO: `/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e/users/5ca442117e344ba4ab15daf1f0b05855/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:52.458359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c2a07c33e944bc966f8ab2434f5f3e, user_id=5ca442117e344ba4ab15daf1f0b05855, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:52.461111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71428e55-c93c-4138-8bc1-8b791951edba admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:52.479818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1331/2654] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:52 2022] PUT /identity/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e/users/5ca442117e344ba4ab15daf1f0b05855/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:27:53.428084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:53.430059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:53.450801 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810697f5-b1a5-4416-aa43-1ece1df7fe4f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:53.516426 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:53.529655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:53.530852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.532215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.532664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] PATH_INFO: `/v3/users/3ad422154a9b4dc2b207eb67ae0d12ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.534259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ad422154a9b4dc2b207eb67ae0d12ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:53.537952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:53.795841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ad422154a9b4dc2b207eb67ae0d12ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.862197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ad422154a9b4dc2b207eb67ae0d12ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.881715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ad422154a9b4dc2b207eb67ae0d12ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.955483 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ad422154a9b4dc2b207eb67ae0d12ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.956221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ad422154a9b4dc2b207eb67ae0d12ad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:53.969691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1324/2655] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:53 2022] DELETE /identity/v3/users/3ad422154a9b4dc2b207eb67ae0d12ad => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:53.973929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:53.974768 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:53.975238 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:53.997167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:53.998643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.089287 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1332/2656] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:54.102642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:54.105960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:54.208455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3588cb-71c0-4e5a-a7b8-4621f266d8df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:54.213215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:54.213888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:54.214177 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:54.214460 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:54.226999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:54.228770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:54.245333 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1325/2657] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:55.232015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.233707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:55.250082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00afa21-b639-4735-ad42-0a068b8a3417 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.258162 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.259253 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.259691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.260322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] PATH_INFO: `/v3/projects/75ff5e7a76af43648aeb496621d8d547` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.262095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75ff5e7a76af43648aeb496621d8d547)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.264341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.425900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75ff5e7a76af43648aeb496621d8d547', 'request_id': 'req-92f6758e-19a9-4820-bd25-85a4cedc370d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.440911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75ff5e7a76af43648aeb496621d8d547', 'request_id': 'req-92f6758e-19a9-4820-bd25-85a4cedc370d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.533056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75ff5e7a76af43648aeb496621d8d547', 'request_id': 'req-92f6758e-19a9-4820-bd25-85a4cedc370d'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.558967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] The token cache is being invalidate because project 75ff5e7a76af43648aeb496621d8d547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:55.559968 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.561277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.563969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1333/2658] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:55 2022] DELETE /identity/v3/projects/75ff5e7a76af43648aeb496621d8d547 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:55.567689 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:55.588041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d61174-18c0-4791-beb2-61a860e9db37 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:55.688649 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:55.689672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:55.689952 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:55.690461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] PATH_INFO: `/v3/users/7e0cf582184344d1b7bbede788c4c922` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:55.692000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0cf582184344d1b7bbede788c4c922)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:55.694337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:55.717256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:55.958041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0cf582184344d1b7bbede788c4c922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.978225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0cf582184344d1b7bbede788c4c922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:55.994435 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0cf582184344d1b7bbede788c4c922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.092395 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0cf582184344d1b7bbede788c4c922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.093245 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0cf582184344d1b7bbede788c4c922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.105752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1326/2659] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:55 2022] DELETE /identity/v3/users/7e0cf582184344d1b7bbede788c4c922 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:56.292392 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.294689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.310589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6758e-19a9-4820-bd25-85a4cedc370d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.444615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:56.490060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.491124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.491420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.492328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] PATH_INFO: `/v3/users/50724984775d4248a5975459d8c2c76a` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.495196 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50724984775d4248a5975459d8c2c76a)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.506695 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.707902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50724984775d4248a5975459d8c2c76a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.721199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50724984775d4248a5975459d8c2c76a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.730975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50724984775d4248a5975459d8c2c76a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.779586 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:56.784382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:56.799464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55000de-074f-41d8-9374-353ef960178d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:56.801325 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50724984775d4248a5975459d8c2c76a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.802404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-8427d5c3-465d-4f06-8fca-b6ba2a4f6e68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50724984775d4248a5975459d8c2c76a'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.810449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:56.811339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:56.811628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:56.811908 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] PATH_INFO: `/v3/projects/2d8c9534ae814d9392814d787599dc24` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:56.827686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8c9534ae814d9392814d787599dc24)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:56.829880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:56.830181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1334/2660] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:27:56 2022] DELETE /identity/v3/users/50724984775d4248a5975459d8c2c76a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:56.971431 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8c9534ae814d9392814d787599dc24', 'request_id': 'req-e4277bb5-1240-47c9-a2e3-bba0230af311'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:56.979985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8c9534ae814d9392814d787599dc24', 'request_id': 'req-e4277bb5-1240-47c9-a2e3-bba0230af311'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.053335 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8c9534ae814d9392814d787599dc24', 'request_id': 'req-e4277bb5-1240-47c9-a2e3-bba0230af311'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.068257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] The token cache is being invalidate because project 2d8c9534ae814d9392814d787599dc24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:57.068743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.070143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4277bb5-1240-47c9-a2e3-bba0230af311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.072201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1327/2661] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:56 2022] DELETE /identity/v3/projects/2d8c9534ae814d9392814d787599dc24 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:57.078314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.079153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.079530 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.122740 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.125019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.195982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1335/2662] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:57.205088 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.205370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.205722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.231222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.232852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.251090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1328/2663] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.252386 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.252756 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.253915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.269726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280e172-3e66-4435-9ef2-df6e8c41199a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.278991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cc86a-da32-4461-bf15-963b34947377 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.284711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.284888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.285036 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.285320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.285602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.286033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.286738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:57.286863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.286863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] PATH_INFO: `/v3/projects/2383d509edfc48d5a3b2f23124f584ab` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.287050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.288774 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.288897 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2383d509edfc48d5a3b2f23124f584ab)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.291675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.302879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1329/2664] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:57.307223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.333170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd1879-ffd9-4e9a-bb60-25520c190b7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.339243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.340550 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.340910 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.341260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.342034 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.344053 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.423984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2383d509edfc48d5a3b2f23124f584ab', 'request_id': 'req-c0243297-d59f-4c24-965b-087ed79c6a28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.432226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2383d509edfc48d5a3b2f23124f584ab', 'request_id': 'req-c0243297-d59f-4c24-965b-087ed79c6a28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.434651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:57.514119 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1330/2665] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:57.518205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.532008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2383d509edfc48d5a3b2f23124f584ab', 'request_id': 'req-c0243297-d59f-4c24-965b-087ed79c6a28'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.546699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] The token cache is being invalidate because project 2383d509edfc48d5a3b2f23124f584ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:27:57.547277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.548809 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c0243297-d59f-4c24-965b-087ed79c6a28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:27:57.551699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1336/2666] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:27:57 2022] DELETE /identity/v3/projects/2383d509edfc48d5a3b2f23124f584ab => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:57.557143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9334d-8ddc-40a6-860e-98545d1dd365 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.557557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9334d-8ddc-40a6-860e-98545d1dd365 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.557955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd9334d-8ddc-40a6-860e-98545d1dd365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.574558 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:57.584453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3bd9334d-8ddc-40a6-860e-98545d1dd365 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.585765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3bd9334d-8ddc-40a6-860e-98545d1dd365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.624879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1aa8-3ab7-4993-bc57-d12b01e3eae9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.630212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.631298 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.631812 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.633069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.633946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.636145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.673069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1337/2667] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:57.682655 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.682949 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.683229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.705450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:57.706918 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.716733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1338/2668] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:57.721020 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.740289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1331/2669] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/users => generated 293 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:57.741335 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1698603d-c569-4112-8625-cbab5a3b9598 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.743742 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.745964 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:57.754414 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.755152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.755427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.755709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.756607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:27:57.756821 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.762796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.764933 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d83ce-5d61-4731-825a-6ba86f5c9987 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.769338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.770091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.770447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.771022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.771970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.773872 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.786371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1339/2670] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:27:57.786585 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1332/2671] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:57.787817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.797596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.802357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945721b8-e3b7-4e84-b7cc-b0417f55c8c3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.820499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.824143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.824143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.824143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.824143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.825014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.833034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc63067-e7b5-4d28-bc0b-27be98c1f177 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.853382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.855141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.855806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.856288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.857494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.862639 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.875726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1340/2672] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:57.876848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:57.887438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bad14-b0a7-4b5e-8a36-0d87693e4fac admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:57.897500 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:57.898711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:57.899120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:57.899475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] PATH_INFO: `/v3/projects/f3bece274ea74f9fb7b01f85c98ad562/users/15a58be30ebd44a3ad542f863f16ea5a/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:57.920746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3bece274ea74f9fb7b01f85c98ad562, user_id=15a58be30ebd44a3ad542f863f16ea5a, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:57.923482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124410b-410a-42a1-aa2b-c352c4ed2e61 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:57.941730 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1333/2673] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/projects => generated 377 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:57.945757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.001642 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1341/2674] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:57 2022] PUT /identity/v3/projects/f3bece274ea74f9fb7b01f85c98ad562/users/15a58be30ebd44a3ad542f863f16ea5a/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:58.012939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.013244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.013531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.034816 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a0954-ed73-46a6-8652-c14cc8dc22d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.053444 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] MFA Rules not processed for user `15a58be30ebd44a3ad542f863f16ea5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:58.056841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.126127 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.126814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.127101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.127377 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.128076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.130449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.150393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1342/2675] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:58.154441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.165807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c526d5da-570c-49e8-b40b-ae0f0a52f7e5 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.170930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.171670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.172516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.172640 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.173711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.175684 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.221357 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1334/2676] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:57 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:58.227757 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.240690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463a814-91bb-476e-9f23-6882e4073a26 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.256754 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.264707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.265795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.268059 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.269049 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.272135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.298401 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1335/2677] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:58.301515 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.303745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1343/2678] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:27:58.304727 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.322772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916fb40e-07fc-47d3-a256-90af4d8a07e9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.430166 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.430859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.430982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0093c6-cf81-43f6-956e-5da90eb83cd1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.431566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.431852 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.432745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.437584 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.438534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.438844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.439447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.439769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.440588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.445270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.465909 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1336/2679] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:58.467069 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.480048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2f2ac-6edd-4c73-af2e-5a7993bcf8b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.485477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.486636 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.487089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.487518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] PATH_INFO: `/v3/projects/ad1159bce4d44d7eb205a2a70f2385f0/users/dd79fc6511514f8bafb39c8bb6d1d0cf/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.508051 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1159bce4d44d7eb205a2a70f2385f0, user_id=dd79fc6511514f8bafb39c8bb6d1d0cf, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.510922 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e94cc97-45f5-4033-aa28-ed01c7ffb097 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.557982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1344/2680] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:58.559250 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.570407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e57f62-85cb-4197-a422-646b9b982397 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.575095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.575766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.576051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.576374 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.577254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.578873 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.590888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1345/2681] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:58.595344 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.602623 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1337/2682] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:58 2022] PUT /identity/v3/projects/ad1159bce4d44d7eb205a2a70f2385f0/users/dd79fc6511514f8bafb39c8bb6d1d0cf/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:58.607666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.607978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.608273 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.615157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e653b625-54ad-4f87-bbe0-27b7712b6e90 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.628371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:58.629974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.687509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.688228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.688894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.689181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.689929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.692353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.718997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1338/2683] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:58.726866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:58.732169 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1346/2684] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:58.732291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.735467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:58.739302 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:58.750260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dd369-a0b9-44bb-883e-58f22ebb4c80 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.757916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.758961 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.759260 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.759525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] PATH_INFO: `/v3/projects/c7d425b7d7144896914c7346ab5336d4/users/3b6c38ddea90440794c35629c68108d5/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.794463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d425b7d7144896914c7346ab5336d4, user_id=3b6c38ddea90440794c35629c68108d5, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.800859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.818795 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3580e3-e140-46a5-9b1e-0158904d6a04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:58.825106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:58.825836 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.826135 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.826416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.836766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:58.838361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd533f4d-4afd-47d0-96d1-37552cbee31c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:58.844784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:58.849720 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1339/2685] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:27:58.865874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1347/2686] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:58 2022] PUT /identity/v3/projects/c7d425b7d7144896914c7346ab5336d4/users/3b6c38ddea90440794c35629c68108d5/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:58.878288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5407f-f933-4053-86be-35dca60195ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:58.878608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5407f-f933-4053-86be-35dca60195ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:58.878891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede5407f-f933-4053-86be-35dca60195ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:58.908898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ede5407f-f933-4053-86be-35dca60195ab None None] MFA Rules not processed for user `3b6c38ddea90440794c35629c68108d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:58.910153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ede5407f-f933-4053-86be-35dca60195ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.010229 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1340/2687] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:59.014708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.104461 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac18ec-9bf9-4d29-b5da-217ab4b64b5b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.109517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.110207 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.110494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.110779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.111493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.113534 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec957478-9d0c-471e-87b8-e101929e03c6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.215698 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1348/2688] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:59.220663 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5407f-f933-4053-86be-35dca60195ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.240646 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede5407f-f933-4053-86be-35dca60195ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.326577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.327560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.328009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.331995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.331995 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.339312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.364105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.364519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.364704 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.395632 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] MFA Rules not processed for user `5ca442117e344ba4ab15daf1f0b05855`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.397170 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.413568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:59.445400 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1341/2689] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:27:59.446508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.466225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734b7787-1aba-4546-8bc6-419ee7b4f79f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.472178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.473300 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.478014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.478014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.478014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.478014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.495827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1342/2690] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:27:59.501193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.512527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1349/2691] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:27:59.528327 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.529939 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.531175 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e164e30-e3be-4aa7-a59a-00f5dc6f84c3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.545813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.547364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.547810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.548497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] PATH_INFO: `/v3/projects/92e265597bff4a0893bf7e015522d414/users/56d3c44c12254bccbc0d28b089227b76/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.566150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e265597bff4a0893bf7e015522d414, user_id=56d3c44c12254bccbc0d28b089227b76, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.570287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.597992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53c0b-947c-4fe5-b48b-5067416939ca None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.601397 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.602150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.602505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.602846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.604791 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.655948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:27:59.664465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1343/2692] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:59 2022] PUT /identity/v3/projects/92e265597bff4a0893bf7e015522d414/users/56d3c44c12254bccbc0d28b089227b76/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:59.670110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.687888 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.689935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.701138 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1350/2693] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:27:59.758319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d09835-4c63-4106-994d-3c779b879039 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.764319 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.765956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.765956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.765956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.766327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.767949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81651a1d-59b2-48a0-8e04-7ca723770648 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.779096 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1344/2694] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:27:59.783540 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.795505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4043b-e9cb-43a3-a4a9-cef822d8c0fc service glance] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:27:59.801146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:27:59.802973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.803316 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.803770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] PATH_INFO: `/v3/projects/92e265597bff4a0893bf7e015522d414/users/56d3c44c12254bccbc0d28b089227b76/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.807274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92e265597bff4a0893bf7e015522d414, user_id=56d3c44c12254bccbc0d28b089227b76, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:27:59.810111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12114f-a6e1-4603-b1f0-3961b28f8c47 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:27:59.827588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1351/2695] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:27:59 2022] PUT /identity/v3/projects/92e265597bff4a0893bf7e015522d414/users/56d3c44c12254bccbc0d28b089227b76/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:27:59.847433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.847960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.847960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.881662 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] MFA Rules not processed for user `56d3c44c12254bccbc0d28b089227b76`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:27:59.883599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:27:59.974170 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1345/2696] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:27:59.980772 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:27:59.981059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:27:59.981390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:27:59.985722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:27:59.987225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.002994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:00.004354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.023905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.055247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb561cd-e0d0-4ce9-9af2-8069b991aa1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.061709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.062389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.062676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.063134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.073015 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1352/2697] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:27:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:00.097554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:00.099213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:00.128391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.140572 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.144701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:00.151404 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1346/2698] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:00.193078 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dcc39-21bd-407f-9ed4-05d0d28b33fe None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:00.199593 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:00.200521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:00.200899 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:00.201276 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:00.237843 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:00.239670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:00.269213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1353/2699] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:28:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 18:28:02.516086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:02.518206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:02.546492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74118ce2-fa2a-4ea4-b6cf-26fb99a5f4d8 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:02.555690 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:02.559256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:02.559256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:02.559256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:02.684768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:02.708966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:02.713654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260aa0bd-d08a-40cd-beb1-fe1d57ef10cb service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:02.732877 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1347/2700] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:05.034662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:05.049001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1028b00d-0ed0-480c-bbc0-6dfc5a2855d7 service swift] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:05.061692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:05.061692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:05.061692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:05.061692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:05.125596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:05.125596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:05.141806 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1354/2701] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:28:06.415622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaf6e-b0c8-4f99-b62e-8abe0b9c6e09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.415622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaf6e-b0c8-4f99-b62e-8abe0b9c6e09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.415622 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09eaf6e-b0c8-4f99-b62e-8abe0b9c6e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.469371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d09eaf6e-b0c8-4f99-b62e-8abe0b9c6e09 None None] MFA Rules not processed for user `dd79fc6511514f8bafb39c8bb6d1d0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:06.471218 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d09eaf6e-b0c8-4f99-b62e-8abe0b9c6e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.667569 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1348/2702] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:06.671841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:06.673384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:06.845334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d62c18-4d2e-4212-9fb7-0fb8450375a6 service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:06.856676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:06.856676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:06.856676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:06.856676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:06.878168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:06.880390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:06.910651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1355/2703] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:09.873455 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:09.874028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:09.874253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:09.895224 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] MFA Rules not processed for user `dd79fc6511514f8bafb39c8bb6d1d0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:09.896476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:09.905081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1349/2704] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:10.314524 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:10.322341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=100 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:10.608193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267f93c-7b26-4278-af51-3a59b6a6df11 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:10.614490 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:10.616624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:10.617084 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:10.617528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:10.620749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:10.635193 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:10.642924 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cd037-6573-41a7-a03b-14ca99f7c40f service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:10.668748 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1356/2705] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:10.920222 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.058525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e30e7-76ac-4167-aa39-3d751901b508 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.064459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.066011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.066543 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.067095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] PATH_INFO: `/v3/users/15a58be30ebd44a3ad542f863f16ea5a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.070076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15a58be30ebd44a3ad542f863f16ea5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.072476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.335097 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15a58be30ebd44a3ad542f863f16ea5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:11.356940 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15a58be30ebd44a3ad542f863f16ea5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:11.373759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15a58be30ebd44a3ad542f863f16ea5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:11.376817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:11.476016 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15a58be30ebd44a3ad542f863f16ea5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:11.476752 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15a58be30ebd44a3ad542f863f16ea5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:11.489541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1350/2706] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:10 2022] DELETE /identity/v3/users/15a58be30ebd44a3ad542f863f16ea5a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:11.494127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.495067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.499796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.541937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:11.543190 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.701732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1357/2707] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:11.712413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:11.713870 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:11.846972 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc8f2b-5b96-4ad1-9648-2c291dc69b20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:11.854068 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:11.855702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:11.857865 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:11.858006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:11.886337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:11.895980 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:11.927194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1351/2708] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:12.446526 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.448745 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:12.462948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e08181-e95f-4d2b-abda-06cdd3630532 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.468965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.470025 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.470598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.470997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] PATH_INFO: `/v3/projects/f3bece274ea74f9fb7b01f85c98ad562` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.472962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3bece274ea74f9fb7b01f85c98ad562)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.478300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:12.663475 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3bece274ea74f9fb7b01f85c98ad562', 'request_id': 'req-a3364eb3-af49-46e7-9c40-880f714e254c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:12.675223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3bece274ea74f9fb7b01f85c98ad562', 'request_id': 'req-a3364eb3-af49-46e7-9c40-880f714e254c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:12.743643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3bece274ea74f9fb7b01f85c98ad562', 'request_id': 'req-a3364eb3-af49-46e7-9c40-880f714e254c'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:12.762202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] The token cache is being invalidate because project f3bece274ea74f9fb7b01f85c98ad562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:12.763016 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:12.764337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:12.766130 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1358/2709] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:12 2022] DELETE /identity/v3/projects/f3bece274ea74f9fb7b01f85c98ad562 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:12.770195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:12.784676 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad878375-af5f-455f-9c72-3d7544a8e1e4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:12.864303 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:12.865231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:12.865511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:12.865778 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] PATH_INFO: `/v3/users/3b6c38ddea90440794c35629c68108d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:12.867984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6c38ddea90440794c35629c68108d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:12.870056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:13.054905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6c38ddea90440794c35629c68108d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:13.068271 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6c38ddea90440794c35629c68108d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:13.076205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6c38ddea90440794c35629c68108d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:13.143232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6c38ddea90440794c35629c68108d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:13.144003 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6c38ddea90440794c35629c68108d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:13.151347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1352/2710] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:12 2022] DELETE /identity/v3/users/3b6c38ddea90440794c35629c68108d5 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:13.904029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:13.906093 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:13.922101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3364eb3-af49-46e7-9c40-880f714e254c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:13.958697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:13.996709 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:13.997693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:13.998286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:13.998680 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] PATH_INFO: `/v3/projects/c7d425b7d7144896914c7346ab5336d4` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.000554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d425b7d7144896914c7346ab5336d4)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.002965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.128157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d425b7d7144896914c7346ab5336d4', 'request_id': 'req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.128157 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d425b7d7144896914c7346ab5336d4', 'request_id': 'req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.223994 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d425b7d7144896914c7346ab5336d4', 'request_id': 'req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.236980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] The token cache is being invalidate because project c7d425b7d7144896914c7346ab5336d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:14.237554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.238431 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c56dcbf0-5aad-4c4c-bd36-9f379ff0803e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.240466 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1359/2711] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:13 2022] DELETE /identity/v3/projects/c7d425b7d7144896914c7346ab5336d4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:14.244179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:14.245817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:14.260080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed6ffaa-d9a2-4de1-b91c-8d1804668cd8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:14.274061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:14.322446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:14.323355 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.323657 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.323935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] PATH_INFO: `/v3/users/56d3c44c12254bccbc0d28b089227b76` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:14.325188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] RBAC: Authorizing `identity:delete_user(user_id=56d3c44c12254bccbc0d28b089227b76)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:14.327189 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:14.616959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56d3c44c12254bccbc0d28b089227b76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.635570 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56d3c44c12254bccbc0d28b089227b76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.655912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56d3c44c12254bccbc0d28b089227b76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.751638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56d3c44c12254bccbc0d28b089227b76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.755862 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56d3c44c12254bccbc0d28b089227b76'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:14.765107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1353/2712] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:14 2022] DELETE /identity/v3/users/56d3c44c12254bccbc0d28b089227b76 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:14.973910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958d48-3702-466c-b4b8-4bc517168f1c None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:14.974581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958d48-3702-466c-b4b8-4bc517168f1c None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:14.976986 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a958d48-3702-466c-b4b8-4bc517168f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.011044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-7a958d48-3702-466c-b4b8-4bc517168f1c None None] MFA Rules not processed for user `f854a7c1e5a94725945a9fef455ce443`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:15.015148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7a958d48-3702-466c-b4b8-4bc517168f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.105638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1360/2713] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:15.482659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:15.484179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.573718 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e17ce1-0afb-4ca8-85c3-4a41abf6708c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.578750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.579660 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.579948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.580257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] PATH_INFO: `/v3/projects/92e265597bff4a0893bf7e015522d414` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.581596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] RBAC: Authorizing `identity:delete_project(project_id=92e265597bff4a0893bf7e015522d414)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.585835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:15.678315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:15.686560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92e265597bff4a0893bf7e015522d414', 'request_id': 'req-cecf24f2-e040-41db-8708-093d3bee249d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.692733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92e265597bff4a0893bf7e015522d414', 'request_id': 'req-cecf24f2-e040-41db-8708-093d3bee249d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.777427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92e265597bff4a0893bf7e015522d414', 'request_id': 'req-cecf24f2-e040-41db-8708-093d3bee249d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.788828 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] The token cache is being invalidate because project 92e265597bff4a0893bf7e015522d414 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:15.789116 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.789783 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cecf24f2-e040-41db-8708-093d3bee249d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:15.791340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1354/2714] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:15 2022] DELETE /identity/v3/projects/92e265597bff4a0893bf7e015522d414 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:15.797357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.797672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.798033 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.820362 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:15.822049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.889222 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1361/2715] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:15.898503 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.898794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.899075 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.917840 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:15.919046 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:15.927468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1355/2716] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:15.932034 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:15.941988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b518d81b-e5ba-413e-a8aa-896e4d134d7d None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.947515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.948200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.948483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.948762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.949484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:15.949789 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.951410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:15.953068 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:15.969112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1362/2717] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:15.970336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:15.979696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce9f49e-3257-4839-9606-975573ff3228 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:15.984439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:15.985085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:15.985373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:15.985652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:15.986339 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:15.988249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.074246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1356/2718] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:15 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:16.078203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.093360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ae9a2-338e-4ff9-9e9d-959ab391c608 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.190161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.191151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.191608 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.192043 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.192998 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.196784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.327129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1363/2719] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:16 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:16.332194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.349505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffcb3-cf84-46be-b401-41e05a73abdd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.355126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.355799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.356080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.356462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.357144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.358802 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.370983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1357/2720] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:16.374922 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.387517 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e15989-9ed7-42a1-9298-4cfd3bef9c6e admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.393177 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.393818 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.394218 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.394503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.395237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.396869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd46cb-5883-45e0-8ac6-352a6de1a829 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.407467 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1364/2721] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:16.411747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.421942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c12306-59e2-405c-991d-be9b541f568d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.426884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.429072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.429459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.429799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] PATH_INFO: `/v3/projects/683f708d281143eb8c61b03229cc8413/users/de7079d188eb4b578a9913824bff7a14/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.445726 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] RBAC: Authorizing `identity:create_grant(project_id=683f708d281143eb8c61b03229cc8413, user_id=de7079d188eb4b578a9913824bff7a14, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.448326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.597954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1358/2722] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:16 2022] PUT /identity/v3/projects/683f708d281143eb8c61b03229cc8413/users/de7079d188eb4b578a9913824bff7a14/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:16.609001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21260-cef1-48fa-8ebf-9c3721c378f5 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.609382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21260-cef1-48fa-8ebf-9c3721c378f5 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.609758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac21260-cef1-48fa-8ebf-9c3721c378f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.639691 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-4ac21260-cef1-48fa-8ebf-9c3721c378f5 None None] MFA Rules not processed for user `de7079d188eb4b578a9913824bff7a14`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:16.641395 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4ac21260-cef1-48fa-8ebf-9c3721c378f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.724277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1365/2723] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:16.732859 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:16.734532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:16.797510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e93677-9f3f-4225-8710-b793df54493e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:16.801453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:16.802137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:16.802437 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:16.802723 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:16.813083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:16.814464 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:16.824505 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1359/2724] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:19.343049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.343545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.343663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.361398 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:19.362591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.419810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1366/2725] 10.222.0.33 () {58 vars in 1009 bytes} [Tue Jul 12 18:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:19.433472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.439188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:19.505681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c03-aa66-46c0-901e-c2545ebc7fc3 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:19.511450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:19.512100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:19.512416 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:19.512697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:19.517997 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:19.521806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:19.524011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0d33a2-69de-482f-8b79-46befc1a4a90 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:19.534340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1360/2726] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:28:19.907521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:19.918303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:20.027081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b20bb-0ea7-4c2e-8ed7-3ba510ff1a58 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.039752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.044069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.044069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.044069 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] PATH_INFO: `/v3/users/de7079d188eb4b578a9913824bff7a14` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.053910 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7079d188eb4b578a9913824bff7a14)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.059889 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.310786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7079d188eb4b578a9913824bff7a14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.339384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7079d188eb4b578a9913824bff7a14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.360198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7079d188eb4b578a9913824bff7a14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.480826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7079d188eb4b578a9913824bff7a14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.483734 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7079d188eb4b578a9913824bff7a14'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:20.495796 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1367/2727] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:19 2022] DELETE /identity/v3/users/de7079d188eb4b578a9913824bff7a14 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:20.496965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.497413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.497524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.524788 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:20.525978 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.641314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1361/2728] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:20.652710 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:20.654165 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:20.770455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ca3cf-7612-4f21-9936-4fee5288d50b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:20.781529 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:20.783216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:20.784005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:20.784508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:20.805382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:20.813153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e9a84-95e5-43ae-9022-e39fc87f1f47 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:20.865925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1368/2729] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:21.659351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:21.661126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:21.683467 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6358e-8c3e-4034-955e-df6b9fc8640b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:21.705315 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:21.706692 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.709212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.710538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] PATH_INFO: `/v3/projects/683f708d281143eb8c61b03229cc8413` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:21.712899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=683f708d281143eb8c61b03229cc8413)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:21.721575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:21.874152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '683f708d281143eb8c61b03229cc8413', 'request_id': 'req-c36c8193-3211-4647-bb36-b0d62647e43d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:21.881948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '683f708d281143eb8c61b03229cc8413', 'request_id': 'req-c36c8193-3211-4647-bb36-b0d62647e43d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:21.955074 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '683f708d281143eb8c61b03229cc8413', 'request_id': 'req-c36c8193-3211-4647-bb36-b0d62647e43d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:21.968507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] The token cache is being invalidate because project 683f708d281143eb8c61b03229cc8413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:21.968970 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:21.969629 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36c8193-3211-4647-bb36-b0d62647e43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:21.971225 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1362/2730] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:21 2022] DELETE /identity/v3/projects/683f708d281143eb8c61b03229cc8413 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:21.977184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:21.977675 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:21.983595 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.001750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.002978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.036775 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:22.087432 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1369/2731] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:28:22.095307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.095665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.096018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.119813 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.121392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:22.133625 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1363/2732] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:22.135736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.146696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6030a-cffa-4086-a692-fecba6b409cc None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.152771 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.153451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.153741 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.154027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.154774 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:22.155509 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.156752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.174155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1370/2733] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 18:28:22.175048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.185226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ec34-e3a4-4919-bd62-62274b24ef2b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.195176 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.196956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.197240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.197513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.200547 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.204191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.311124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1364/2734] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.316038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.326549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0135d1b-1c2c-4166-9730-9bda539a73ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.399907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.400871 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.401167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.401450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.402154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.404426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.505807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1371/2735] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:22.510354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.553124 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3eb55-7898-474d-9417-3848039afbd9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.558436 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.559481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.560900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.561422 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.562386 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.564916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.594125 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1365/2736] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:22.595060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.609489 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd11518-9dc4-42a1-b403-d2953fc24aec admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.622575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.623022 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.623318 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.623606 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.624388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.626077 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812b9bc-8011-40fe-916b-f996f4fd6aad admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.674810 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1372/2737] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:28:22.678747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:22.692162 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1da6b-6fe2-42d4-a87e-2d08e21e5ad4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:22.707336 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:22.708418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.708707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.708985 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] PATH_INFO: `/v3/projects/c6759f9349d747cba075e3e8550fe165/users/afe48b64affc4953b320bbf471fba13b/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.759784 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6759f9349d747cba075e3e8550fe165, user_id=afe48b64affc4953b320bbf471fba13b, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:22.764507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:22.869888 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1366/2738] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:22 2022] PUT /identity/v3/projects/c6759f9349d747cba075e3e8550fe165/users/afe48b64affc4953b320bbf471fba13b/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:22.939339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:22.939626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:22.939858 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:22.972451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] MFA Rules not processed for user `afe48b64affc4953b320bbf471fba13b`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:22.973808 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.065527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1373/2739] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:23.078261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:23.080399 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:23.096531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:23.142340 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cf2955-267f-46ca-9be7-cd866a70159e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:23.146028 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bc8f7da375441049d3975f1b80951a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:23.146683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:23.146996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:23.147288 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:23.157221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:23.158842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:23.175996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1367/2740] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:32.129424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:32.135254 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.176173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:32.245054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fb242-66ee-4932-bc46-224b2442488a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:32.253213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50043e6bb2414d7dbf9feecd1b1980bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:32.256604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:32.256604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:32.256604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:32.258058 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:32.281559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:32.283357 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:32.323095 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1374/2741] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:33.200475 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=20 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:37.686407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:37.687926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:37.744733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2786c-75fe-46de-8d28-37365191f39c service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:37.748444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:37.749086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:37.749369 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:37.749642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:37.751412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:37.819912 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:37.821482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:37.832247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1368/2742] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:41.841056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:41.850966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be75a7-2940-43ed-bea7-051c0d09a088 service nova] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:41.860353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:41.860353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:41.860353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:41.860353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:41.860782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:41.923857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:41.925381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:41.935324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1375/2743] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:45.698745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:45.700969 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:45.715272 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b010ac3-8137-406a-a3f6-4e1d6b8f5045 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:45.719989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:45.720901 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:45.723174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:45.723174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] PATH_INFO: `/v3/users/93f5a80ad4564329aa4f075f3e18ce97` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:45.723174 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f5a80ad4564329aa4f075f3e18ce97)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:45.725306 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:45.933388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f5a80ad4564329aa4f075f3e18ce97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:45.944984 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f5a80ad4564329aa4f075f3e18ce97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:45.951939 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f5a80ad4564329aa4f075f3e18ce97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.034077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f5a80ad4564329aa4f075f3e18ce97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.034794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f5a80ad4564329aa4f075f3e18ce97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.041989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1369/2744] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:45 2022] DELETE /identity/v3/users/93f5a80ad4564329aa4f075f3e18ce97 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:46.325154 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:46.344706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c5f22-d973-40d1-885b-c09c3a93b190 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:46.404317 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:46.405175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:46.405455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:46.405729 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] PATH_INFO: `/v3/projects/a6ddd799b01349669cf6dadc85008078` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:46.406903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6ddd799b01349669cf6dadc85008078)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:46.408814 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:46.552902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:46.559182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6ddd799b01349669cf6dadc85008078', 'request_id': 'req-61715063-c042-472a-9a27-51ef5c8eeed5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.570550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6ddd799b01349669cf6dadc85008078', 'request_id': 'req-61715063-c042-472a-9a27-51ef5c8eeed5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.634286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6ddd799b01349669cf6dadc85008078', 'request_id': 'req-61715063-c042-472a-9a27-51ef5c8eeed5'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.645159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] The token cache is being invalidate because project a6ddd799b01349669cf6dadc85008078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:46.645451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.646075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.648213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1376/2745] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:46 2022] DELETE /identity/v3/projects/a6ddd799b01349669cf6dadc85008078 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:46.652275 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:46.653765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:46.669529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2b392-8900-45f3-b5b5-a4f36f9ecc88 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:46.688293 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:46.725737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:46.726532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:46.726814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:46.727089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] PATH_INFO: `/v3/users/0967c98f75b745f38094d56c77041eaf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:46.728292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0967c98f75b745f38094d56c77041eaf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:46.730202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:46.964600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0967c98f75b745f38094d56c77041eaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.976502 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0967c98f75b745f38094d56c77041eaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:46.983251 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0967c98f75b745f38094d56c77041eaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.074109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0967c98f75b745f38094d56c77041eaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.074733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0967c98f75b745f38094d56c77041eaf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.081060 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1370/2746] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:46 2022] DELETE /identity/v3/users/0967c98f75b745f38094d56c77041eaf => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:47.502609 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:47.504295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:47.518188 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61715063-c042-472a-9a27-51ef5c8eeed5 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:47.591866 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:47.592859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.593135 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.593419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] PATH_INFO: `/v3/projects/3dadbc8c2c8747978e17f060b598c326` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.594689 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dadbc8c2c8747978e17f060b598c326)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:47.596679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:47.738482 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dadbc8c2c8747978e17f060b598c326', 'request_id': 'req-4c56c280-97e0-4624-b415-b3d88ffb6561'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.745323 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dadbc8c2c8747978e17f060b598c326', 'request_id': 'req-4c56c280-97e0-4624-b415-b3d88ffb6561'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.811692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dadbc8c2c8747978e17f060b598c326', 'request_id': 'req-4c56c280-97e0-4624-b415-b3d88ffb6561'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.824178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:47.825851 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] The token cache is being invalidate because project 3dadbc8c2c8747978e17f060b598c326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:47.826151 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.826825 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c56c280-97e0-4624-b415-b3d88ffb6561 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:47.828429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1377/2747] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:47 2022] DELETE /identity/v3/projects/3dadbc8c2c8747978e17f060b598c326 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:47.829071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:47.843107 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa6bec-703f-459b-bc9f-ec0c21145ea8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:47.908287 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:47.909278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:47.909563 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:47.909844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] PATH_INFO: `/v3/users/afe48b64affc4953b320bbf471fba13b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:47.911261 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe48b64affc4953b320bbf471fba13b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:47.914866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.171614 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:48.175729 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe48b64affc4953b320bbf471fba13b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.192048 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe48b64affc4953b320bbf471fba13b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.200513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe48b64affc4953b320bbf471fba13b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.303659 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe48b64affc4953b320bbf471fba13b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.304354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe48b64affc4953b320bbf471fba13b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:48.314905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1371/2748] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:28:47 2022] DELETE /identity/v3/users/afe48b64affc4953b320bbf471fba13b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:48.316764 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.317202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.317341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.336518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:48.337957 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.415563 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1378/2749] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:48.419948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.421766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.488179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7265a4f1-f21a-4730-a4da-66b357d8a5a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.492159 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.492991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.493432 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.493935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.503982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.505699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1b2d5-b6b4-4d0c-810b-fbb5e096691f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:48.529562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1372/2750] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:48.973192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:48.974670 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:48.986493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:48.987421 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc9f61-2902-4c11-a0eb-c2af6ef8bb43 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:48.992019 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:48.992909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:48.993195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:48.993470 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] PATH_INFO: `/v3/projects/c6759f9349d747cba075e3e8550fe165` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:48.994788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6759f9349d747cba075e3e8550fe165)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:48.996557 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.113088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6759f9349d747cba075e3e8550fe165', 'request_id': 'req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.119588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6759f9349d747cba075e3e8550fe165', 'request_id': 'req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.222171 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6759f9349d747cba075e3e8550fe165', 'request_id': 'req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.232518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] The token cache is being invalidate because project c6759f9349d747cba075e3e8550fe165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:28:49.232811 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.233450 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-74ac504e-2ff1-4c1b-8a28-2103c307dbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:28:49.235198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1379/2751] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:28:48 2022] DELETE /identity/v3/projects/c6759f9349d747cba075e3e8550fe165 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:28:49.241040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.242129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.242129 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.259342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.260560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.318716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1373/2752] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:49.326424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.326713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.326991 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.344875 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.346060 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.353958 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1380/2753] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:49.358007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.368197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef173e0a-638c-4280-8bbf-f3c9a1453b18 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.372697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.373346 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.373633 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.373914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.374634 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:28:49.374943 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.376573 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.388484 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1374/2754] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:28:49.392411 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.401393 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b23b1-6c95-4547-b603-df83a50068e0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.405964 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.406602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.406885 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.407159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.407833 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.409793 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.514370 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1381/2755] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:49.518607 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.528642 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1c51e-4311-44c0-8fce-909d54269a3f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.575076 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:28:49.584042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.584725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.585009 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.585286 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.585956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.587851 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.702307 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1375/2756] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/users => generated 288 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:28:49.706305 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.717314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219c76e-4f30-4715-8ecc-cb4d55b07715 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.721900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.722553 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.722842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.723122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.723848 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.725587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.736909 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1382/2757] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:49.740982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.750879 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d96d39-1517-4748-859a-e899d8d87886 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.755499 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.756681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.756968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.757246 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.757974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.759567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366be5d-87f4-4f7f-920d-dd42a0f4d5ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.769950 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1376/2758] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:28:49.774677 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:49.784699 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8f1dd-95a1-420a-9821-75d9eed863e0 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:49.789523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:49.790406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.790688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.790963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] PATH_INFO: `/v3/projects/7ad228c8052b43ef8e8be7f212c7420c/users/b2af9f6bea694b7189deee726637ed73/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.805155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad228c8052b43ef8e8be7f212c7420c, user_id=b2af9f6bea694b7189deee726637ed73, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:49.807770 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:49.873952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1383/2759] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:28:49 2022] PUT /identity/v3/projects/7ad228c8052b43ef8e8be7f212c7420c/users/b2af9f6bea694b7189deee726637ed73/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:28:49.885814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:49.886104 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:49.886381 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:49.911668 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] MFA Rules not processed for user `b2af9f6bea694b7189deee726637ed73`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:28:49.913165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:49.993957 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1377/2760] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:28:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:28:50.004659 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:28:50.007111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:28:50.062686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9a073-eb92-4584-85d3-2b89bbb6e515 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:28:50.066268 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:28:50.066903 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:28:50.067184 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:28:50.067453 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:28:50.076085 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:28:50.077522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dba1ed-bf13-48bd-96a2-2cca902c434e service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:28:50.086049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1384/2761] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:28:59.990320 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=43,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:00.082274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.156652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.258057 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe5a0aa-528b-46ab-bbbe-a4fc75b1b179 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.262556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.263418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.263697 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.263974 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] PATH_INFO: `/v3/users/b2af9f6bea694b7189deee726637ed73` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.265194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2af9f6bea694b7189deee726637ed73)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.267101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.418993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2af9f6bea694b7189deee726637ed73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.430613 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2af9f6bea694b7189deee726637ed73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.437389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2af9f6bea694b7189deee726637ed73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.485090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2af9f6bea694b7189deee726637ed73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.485738 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2af9f6bea694b7189deee726637ed73'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:01.491860 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1378/2762] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:29:01 2022] DELETE /identity/v3/users/b2af9f6bea694b7189deee726637ed73 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:01.496419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.497406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.497406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.543706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:29:01.544933 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.601705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1385/2763] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:29:01.611196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:01.612621 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:01.653716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:01.686751 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df9661-9c78-4c27-b53a-7cf9d55489a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:01.690382 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:01.691011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:01.691294 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:01.691568 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:01.701412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:01.702884 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:01.713070 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1379/2764] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:02.097863 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:02.099304 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:02.112842 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98cfd0a-be63-4646-8b16-c0034863fb76 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:02.117574 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:02.118437 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:02.118719 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:02.118992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] PATH_INFO: `/v3/projects/7ad228c8052b43ef8e8be7f212c7420c` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:02.120195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad228c8052b43ef8e8be7f212c7420c)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:02.122232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:02.204460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad228c8052b43ef8e8be7f212c7420c', 'request_id': 'req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:02.210962 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad228c8052b43ef8e8be7f212c7420c', 'request_id': 'req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:02.261803 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad228c8052b43ef8e8be7f212c7420c', 'request_id': 'req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:02.272950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] The token cache is being invalidate because project 7ad228c8052b43ef8e8be7f212c7420c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:29:02.273359 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:02.274000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-a25c1362-ca2e-4aa1-a791-f6e9ee00374b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:29:02.275621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1386/2765] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:29:02 2022] DELETE /identity/v3/projects/7ad228c8052b43ef8e8be7f212c7420c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:29:11.714008 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=16 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:12.269202 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:29:12.469811 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:29:12.471285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.570000 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3ad2af-5c9d-443e-a145-f6d299bdb449 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:29:12.640722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:29:12.641389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:29:12.641678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:29:12.641959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:29:12.643740 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:29:12.656252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:29:12.657846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:29:12.670223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1380/2766] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:29:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:29:22.664524 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=67 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:17.621153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.621626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.621736 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.648497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] MFA Rules not processed for user `89c19949d79a43beb88b88662b0388f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:17.649824 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:17.708600 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1387/2767] 10.222.0.33 () {58 vars in 967 bytes} [Tue Jul 12 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:30:17.748444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:17.749831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:17.818993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c1e627-3219-425f-9c49-c909a5e084f8 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:17.823574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57d606342e46439f8f1274278438fb1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:17.824260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:17.824551 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:17.824834 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:17.833904 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:17.835541 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:17.844398 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1381/2768] 10.222.0.33 () {60 vars in 1384 bytes} [Tue Jul 12 18:30:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 18:30:22.189161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:22.190755 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:22.207278 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cef4809-0565-4332-9b75-3ad957509675 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:22.213391 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:22.214239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:22.214513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:22.214857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:22.216696 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:22.229420 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:22.231071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:22.241255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1388/2769] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:30:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:30:25.631414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:25.644071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ef616-136a-44f3-b80a-b09bc220b020 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:25.653167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:25.653167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:25.653167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:25.653167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:25.653576 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:25.664188 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:25.665769 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:25.676098 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1382/2770] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:30:25.753597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:25.755028 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:25.821499 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc762e02-1454-4c90-8117-e8ba97ec3d12 service placement] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:25.826044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:25.827571 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:25.827862 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:25.828175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] PATH_INFO: `/v3/users/f854a7c1e5a94725945a9fef455ce443` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:25.829381 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=f854a7c1e5a94725945a9fef455ce443)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:25.831295 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:26.016795 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f854a7c1e5a94725945a9fef455ce443'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.028223 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f854a7c1e5a94725945a9fef455ce443'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.035059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f854a7c1e5a94725945a9fef455ce443'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.039153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:26.118001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f854a7c1e5a94725945a9fef455ce443'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.118617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f854a7c1e5a94725945a9fef455ce443'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.125495 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1389/2771] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:30:25 2022] DELETE /identity/v3/users/f854a7c1e5a94725945a9fef455ce443 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:26.412389 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:26.424762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84544d66-2e5b-4e18-b978-e517d8d232d2 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:26.496479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:26.498223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:26.498804 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:26.499152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] PATH_INFO: `/v3/projects/15a3f3bc344441d086cac7d86c4da123` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:26.500846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15a3f3bc344441d086cac7d86c4da123)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:26.503284 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:26.599394 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15a3f3bc344441d086cac7d86c4da123', 'request_id': 'req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.605699 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15a3f3bc344441d086cac7d86c4da123', 'request_id': 'req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.678040 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15a3f3bc344441d086cac7d86c4da123', 'request_id': 'req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.688743 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] The token cache is being invalidate because project 15a3f3bc344441d086cac7d86c4da123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:30:26.689032 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.689665 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.691226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1383/2772] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:30:26 2022] DELETE /identity/v3/projects/15a3f3bc344441d086cac7d86c4da123 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:26.695148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:26.696619 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:26.710349 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c024e-4614-4744-9cce-bb09debea4ed admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:26.765665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:26.766537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:26.766865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:26.767143 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] PATH_INFO: `/v3/users/5ca442117e344ba4ab15daf1f0b05855` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:26.768415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ca442117e344ba4ab15daf1f0b05855)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:26.770336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:26.926185 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ca442117e344ba4ab15daf1f0b05855'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.938701 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ca442117e344ba4ab15daf1f0b05855'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:26.945749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ca442117e344ba4ab15daf1f0b05855'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.032248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ca442117e344ba4ab15daf1f0b05855'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.032861 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-9e1eee4e-eaa8-49be-b335-4d590b660c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ca442117e344ba4ab15daf1f0b05855'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.039379 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1390/2773] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:30:26 2022] DELETE /identity/v3/users/5ca442117e344ba4ab15daf1f0b05855 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:27.285433 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:30:27.286962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:27.300412 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950cf80-4d4e-4e08-9c74-6f554b7b6d90 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:30:27.304312 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:27.358855 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:30:27.359652 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:27.359938 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:27.360248 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] PATH_INFO: `/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:27.361461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c2a07c33e944bc966f8ab2434f5f3e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:30:27.363451 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:30:27.472041 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c2a07c33e944bc966f8ab2434f5f3e', 'request_id': 'req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.478190 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c2a07c33e944bc966f8ab2434f5f3e', 'request_id': 'req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.541061 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c2a07c33e944bc966f8ab2434f5f3e', 'request_id': 'req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.552193 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] The token cache is being invalidate because project 12c2a07c33e944bc966f8ab2434f5f3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:30:27.552510 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.553150 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:30:27.554772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1384/2774] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:30:27 2022] DELETE /identity/v3/projects/12c2a07c33e944bc966f8ab2434f5f3e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:30:37.035430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=55,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:37.548914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:30:56.868790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:30:56.869298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:30:56.869399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:30:56.888129 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] MFA Rules not processed for user `dd79fc6511514f8bafb39c8bb6d1d0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:30:56.889320 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:30:56.944898 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1391/2775] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:30:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:31:06.277311 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:31:06.279024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:06.375269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09363a-c9ec-44fe-a2bd-9abb526ce9c3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:31:06.379866 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:31:06.380644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:31:06.380937 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:31:06.381219 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:31:06.383072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:06.477782 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:31:06.479212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:31:06.500739 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1385/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:31:06.938251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=25 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:10.010507 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:31:10.011923 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:10.023673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dae7e4-df9e-41f2-a39d-353fa01c8f48 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:31:10.027219 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:31:10.027856 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:31:10.028159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:31:10.028441 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:31:10.030669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:31:10.043823 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:31:10.046038 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:31:10.056735 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1392/2777] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:31:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:31:16.497711 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=72 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:31:20.051878 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=6 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:13.905814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:13.909479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:13.973519 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698d6a80-644b-457a-8b88-53fb72eb9704 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:13.977837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:13.978694 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:13.978977 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:13.979252 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] PATH_INFO: `/v3/users/dd79fc6511514f8bafb39c8bb6d1d0cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:13.980450 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd79fc6511514f8bafb39c8bb6d1d0cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:13.982366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:14.164566 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd79fc6511514f8bafb39c8bb6d1d0cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.176405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd79fc6511514f8bafb39c8bb6d1d0cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.183468 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd79fc6511514f8bafb39c8bb6d1d0cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.247981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd79fc6511514f8bafb39c8bb6d1d0cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.248716 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd2ca01-6b42-4ef2-9743-93464737919d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd79fc6511514f8bafb39c8bb6d1d0cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.255496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1386/2778] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:13 2022] DELETE /identity/v3/users/dd79fc6511514f8bafb39c8bb6d1d0cf => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:14.494942 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:14.506963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c9a44-d81e-487c-b516-9638ea5a7eff service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:14.569108 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:14.569969 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:14.570256 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:14.570538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] PATH_INFO: `/v3/projects/ad1159bce4d44d7eb205a2a70f2385f0` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:14.571760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1159bce4d44d7eb205a2a70f2385f0)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:14.573784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:14.670845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1159bce4d44d7eb205a2a70f2385f0', 'request_id': 'req-055640ef-1ea8-4b75-ae81-91393182fe06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.677508 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1159bce4d44d7eb205a2a70f2385f0', 'request_id': 'req-055640ef-1ea8-4b75-ae81-91393182fe06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.733505 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1159bce4d44d7eb205a2a70f2385f0', 'request_id': 'req-055640ef-1ea8-4b75-ae81-91393182fe06'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.744750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] The token cache is being invalidate because project ad1159bce4d44d7eb205a2a70f2385f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:14.745036 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.745662 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-055640ef-1ea8-4b75-ae81-91393182fe06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:14.747204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1393/2779] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:14 2022] DELETE /identity/v3/projects/ad1159bce4d44d7eb205a2a70f2385f0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:14.752577 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:14.752810 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:14.753089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:14.798946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:14.800184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:14.847799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:14.858691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1387/2780] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:14.867064 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:14.867353 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:14.867634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:14.886040 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:14.887273 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:14.895111 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1394/2781] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:14.903115 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:14.912806 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5465bf6-60f5-44a0-ac55-ab0435285173 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:14.918264 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:14.918916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:14.919204 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:14.919482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:14.920250 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:14.920560 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:14.922728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:14.934397 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1388/2782] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:14.939180 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:14.948210 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff431045-10d8-4291-a249-acf8de850b86 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:14.952679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:14.953326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:14.953607 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:14.953883 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:14.954567 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:14.956463 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.071513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1395/2783] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:14 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:15.075555 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:15.085831 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffef85-b9e9-4665-9160-b00cc202b439 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:15.148157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:15.148924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.149215 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.149497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.150195 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:15.152138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.237006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1389/2784] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:15 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:15.241082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:15.251160 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732e35d-70a5-4c59-9722-e034dc737fa8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:15.255762 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:15.256434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.256730 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.257008 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.257732 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:15.259314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.269199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1396/2785] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:15.273143 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:15.283449 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5c091-177d-46f8-b3ca-17d1050d8728 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:15.287966 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:15.288891 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.289186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.289462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.290187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:15.291764 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c74696-363d-4589-9f78-aa047b2a0d62 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.302152 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1390/2786] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:15.305985 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:15.315596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99761347-f0a6-48ff-b2dc-3b7e7a9b8e39 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:15.320076 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:15.320978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.321264 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.321596 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] PATH_INFO: `/v3/projects/da6490e8d306457bac013ec925bc56b3/users/b323038ae82540dbb24860ab5d08d26a/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.336279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da6490e8d306457bac013ec925bc56b3, user_id=b323038ae82540dbb24860ab5d08d26a, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:15.338895 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.443267 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1397/2787] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:15 2022] PUT /identity/v3/projects/da6490e8d306457bac013ec925bc56b3/users/b323038ae82540dbb24860ab5d08d26a/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:15.448345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76635-05db-4d82-9c0d-3ad66011f529 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.448640 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76635-05db-4d82-9c0d-3ad66011f529 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.448924 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76635-05db-4d82-9c0d-3ad66011f529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.466367 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0f76635-05db-4d82-9c0d-3ad66011f529 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:15.467559 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0f76635-05db-4d82-9c0d-3ad66011f529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:15.526996 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1391/2788] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:15.536484 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:15.538228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:15.559269 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:15.594583 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11f350-4b18-43f3-a32d-c59595fb3a50 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:15.598687 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:15.599331 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:15.599618 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:15.600075 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:15.608947 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:15.611700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:15.621403 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1398/2789] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:32:16.746214 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:16.746725 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:16.746850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:16.775916 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] MFA Rules not processed for user `b323038ae82540dbb24860ab5d08d26a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:16.777278 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:16.828735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:16.845944 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1392/2790] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:16 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:16.850449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:16.861145 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07aae5-78eb-4a13-a3e5-d18b7d07f87e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:16.869671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:16.869671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:16.869671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:16.869671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:16.870079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:16.870079 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:16.946901 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1399/2791] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:16 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:16.950853 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:16.962033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d776e85-e602-4b85-835a-ecdf9cdb054a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:17.018056 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:17.018722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.019010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.019285 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:17.019968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:17.021926 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:17.098792 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1393/2792] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:16 2022] POST /identity/v3/users => generated 309 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:17.102752 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:17.113586 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d238c-9922-4e43-8689-570679facf4a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:17.118127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:17.118779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.119062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.119337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:17.120057 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:17.121707 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:17.132790 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1400/2793] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:17.136932 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:17.146803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c7c91-300c-4cff-a050-99ed0775de7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:17.151710 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:17.152644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.152930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.153203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] PATH_INFO: `/v3/projects/0a83629eef734e4ab8e76feacfac4bb2/users/491b37e636044565b51c4a067578d1e5/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:17.168270 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a83629eef734e4ab8e76feacfac4bb2, user_id=491b37e636044565b51c4a067578d1e5, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:17.171014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:17.270488 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1394/2794] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:17 2022] PUT /identity/v3/projects/0a83629eef734e4ab8e76feacfac4bb2/users/491b37e636044565b51c4a067578d1e5/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:17.274303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:17.284678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd7a117-8dcb-4470-b6b2-4ba55c2db4c1 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:17.339535 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:17.340234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.340522 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.340804 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:17.341521 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:17.343119 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22f640-dada-4933-8a49-2e50178c84f7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:17.353226 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1401/2795] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:17.357453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:17.368160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dc3bc-633f-4e8c-b58c-e54b6aace04c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:17.372781 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:17.373651 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:17.373935 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:17.374212 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] PATH_INFO: `/v3/projects/0a83629eef734e4ab8e76feacfac4bb2/users/491b37e636044565b51c4a067578d1e5/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:17.376240 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a83629eef734e4ab8e76feacfac4bb2, user_id=491b37e636044565b51c4a067578d1e5, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:17.378845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:17.389085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1395/2796] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:17 2022] PUT /identity/v3/projects/0a83629eef734e4ab8e76feacfac4bb2/users/491b37e636044565b51c4a067578d1e5/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:18.494056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:18.494604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:18.494828 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:18.524390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] MFA Rules not processed for user `491b37e636044565b51c4a067578d1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:18.525615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:18.599354 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1402/2797] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:18 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:19.878815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:19.943643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c346779-3ffa-40e8-8820-5f508ae06a24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:19.948262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:19.949134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:19.949427 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:19.949706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] PATH_INFO: `/v3/users/b323038ae82540dbb24860ab5d08d26a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:19.950895 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b323038ae82540dbb24860ab5d08d26a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:19.953442 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:20.151015 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:20.152766 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b323038ae82540dbb24860ab5d08d26a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.165378 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b323038ae82540dbb24860ab5d08d26a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.172013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b323038ae82540dbb24860ab5d08d26a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.264497 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b323038ae82540dbb24860ab5d08d26a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.265745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b323038ae82540dbb24860ab5d08d26a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.271915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1396/2798] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:19 2022] DELETE /identity/v3/users/b323038ae82540dbb24860ab5d08d26a => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:20.523541 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:20.535951 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090f26b-1100-4f62-b4c5-af2e5a1f7482 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:20.540995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:20.592988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:20.593844 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:20.594131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:20.594412 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] PATH_INFO: `/v3/projects/da6490e8d306457bac013ec925bc56b3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:20.595617 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da6490e8d306457bac013ec925bc56b3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:20.597559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:20.699044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da6490e8d306457bac013ec925bc56b3', 'request_id': 'req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.705056 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da6490e8d306457bac013ec925bc56b3', 'request_id': 'req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.756186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da6490e8d306457bac013ec925bc56b3', 'request_id': 'req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.766515 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] The token cache is being invalidate because project da6490e8d306457bac013ec925bc56b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:20.766807 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.767425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.768988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1403/2799] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:20 2022] DELETE /identity/v3/projects/da6490e8d306457bac013ec925bc56b3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:20.773073 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:20.774522 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:20.787434 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bf69b-c9f6-473d-9cff-7a981cec9456 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:20.844641 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:20.845552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:20.845846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:20.846128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] PATH_INFO: `/v3/users/491b37e636044565b51c4a067578d1e5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:20.847330 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=491b37e636044565b51c4a067578d1e5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:20.849338 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:20.975247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491b37e636044565b51c4a067578d1e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.987734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491b37e636044565b51c4a067578d1e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:20.994681 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491b37e636044565b51c4a067578d1e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.047960 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491b37e636044565b51c4a067578d1e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.048609 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49e0cd67-4b4a-4d03-bfb4-e3cffd6c9fa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491b37e636044565b51c4a067578d1e5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.054770 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1397/2800] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:20 2022] DELETE /identity/v3/users/491b37e636044565b51c4a067578d1e5 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:21.297638 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:21.299187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:21.311876 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c8474f-08a6-4a0c-9ba3-1e6b8f296738 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:21.373902 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:21.374769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.375055 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.375334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] PATH_INFO: `/v3/projects/0a83629eef734e4ab8e76feacfac4bb2` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.376538 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a83629eef734e4ab8e76feacfac4bb2)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:21.378428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:21.482656 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:21.489081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a83629eef734e4ab8e76feacfac4bb2', 'request_id': 'req-487a3c96-3fe3-4b38-8b30-f0d830f68325'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.495158 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a83629eef734e4ab8e76feacfac4bb2', 'request_id': 'req-487a3c96-3fe3-4b38-8b30-f0d830f68325'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.567494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a83629eef734e4ab8e76feacfac4bb2', 'request_id': 'req-487a3c96-3fe3-4b38-8b30-f0d830f68325'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.578232 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] The token cache is being invalidate because project 0a83629eef734e4ab8e76feacfac4bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:21.578724 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.579855 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-487a3c96-3fe3-4b38-8b30-f0d830f68325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:21.581371 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1404/2801] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:21 2022] DELETE /identity/v3/projects/0a83629eef734e4ab8e76feacfac4bb2 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:21.586208 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.586504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.586787 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.605086 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:21.606423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:21.643797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:21.664773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1398/2802] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:21.672503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.672798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.673081 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.691763 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:21.692988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:21.700785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1405/2803] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:21.705487 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:21.714962 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a33bc-708e-4a13-9ffb-23bf6c276b3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:21.719913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:21.720601 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.720886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.721164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.721886 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:21.722191 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:21.723772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:21.735153 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1399/2804] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:21.739366 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:21.748388 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c4b92-7c40-45fe-a891-9bef44878500 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:21.753460 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:21.754102 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.754383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.754654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.755368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:21.757279 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:21.832382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1406/2805] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:21 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:21.836375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:21.846373 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fd68c-ebfe-4c0b-8e45-963b92915552 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:21.902131 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:21.902796 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:21.903083 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:21.903363 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:21.904044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:21.905991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:21.984863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1400/2806] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:21 2022] POST /identity/v3/users => generated 282 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:21.989053 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:21.999959 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f8cd70-3e7b-429b-b42b-c274d9a46574 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.004737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.005438 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.005725 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.006000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.006754 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.008360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.019229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1407/2807] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:22.023182 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.033243 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6984960-9ae8-405c-a296-e5d31878b32b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.037887 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.038535 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.039080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.039354 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.040071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.041693 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89724cba-be1f-4f1c-b580-d4a2aeba5f3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.051981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1401/2808] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:22.056044 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.066456 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed6a4-1b6d-4f11-8709-30953ad4a9ab admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.071358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.072297 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.072587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.072992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] PATH_INFO: `/v3/projects/954d0c0c45f2433faa9beb09029fe7d0/users/438ac614bbd9493b893ee4f276322541/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.087841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=954d0c0c45f2433faa9beb09029fe7d0, user_id=438ac614bbd9493b893ee4f276322541, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.090487 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.236626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1408/2809] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:22 2022] PUT /identity/v3/projects/954d0c0c45f2433faa9beb09029fe7d0/users/438ac614bbd9493b893ee4f276322541/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:22.248002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.248327 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.248611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.283677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] MFA Rules not processed for user `438ac614bbd9493b893ee4f276322541`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:22.284948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:22.350126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1402/2810] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 18:32:22.354708 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.415410 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e5657-fa65-4464-b2d0-e31fed5a73b3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.420005 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.420694 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.420980 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.421769 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.422511 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.424427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.512104 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1409/2811] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:22 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:22.516002 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.526683 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1267f-c34e-409b-a9a8-85f0dede0965 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.560961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:22.583375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.584050 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.584370 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.584654 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.585345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.587269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.699351 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1403/2812] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:22 2022] POST /identity/v3/users => generated 287 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:22.703051 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.713383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2333d22-708a-443d-8a7e-5eef87f62495 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.718014 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.719181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.719468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.719751 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.720516 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.722105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.732434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1410/2813] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:22.736959 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.746946 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851950a-9843-4ac8-b875-9c08ab954324 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.751482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.752393 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.752677 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.752955 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] PATH_INFO: `/v3/projects/b3c22d06923e4a44932ba878b95f70dc/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.767317 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c22d06923e4a44932ba878b95f70dc, user_id=3bfb2cd4b2fa4f5f9d8ef16052f04c55, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.769981 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.831247 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1404/2814] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:22 2022] PUT /identity/v3/projects/b3c22d06923e4a44932ba878b95f70dc/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:22.835347 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.845852 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b0a55-26bb-4e6d-9212-6c3788ddd03c admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.882358 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:22.900702 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.901367 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.901657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.901941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.902666 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.904311 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee1f7c-68d8-48d8-8722-7655b08b7e43 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.915413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1411/2815] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:22.922595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:22.931295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145669b-3d67-4be6-8ed7-64849755f2b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:22.936201 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:22.937120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.937407 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.937691 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] PATH_INFO: `/v3/projects/b3c22d06923e4a44932ba878b95f70dc/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.939749 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c22d06923e4a44932ba878b95f70dc, user_id=3bfb2cd4b2fa4f5f9d8ef16052f04c55, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:22.942383 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:22.953408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1405/2816] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:22 2022] PUT /identity/v3/projects/b3c22d06923e4a44932ba878b95f70dc/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:22.963309 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:22.963604 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:22.963886 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:22.990565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] MFA Rules not processed for user `3bfb2cd4b2fa4f5f9d8ef16052f04c55`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:22.991784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:23.059720 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1412/2817] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:22 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:23.071092 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:23.072817 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:23.151299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f22ea-a9bf-4ded-b2ac-3f1c814551ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:23.155031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:23.156292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:23.156579 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:23.156854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:23.165923 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:23.167343 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12646fb-8f84-4b65-aebd-bc91a4949bf1 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:23.176638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1406/2818] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:23 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:24.024497 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:24.086027 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade69c1b-f49a-40a8-9b3d-2ea7ee2888d2 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:24.090678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:24.091576 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:24.091869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:24.092183 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] PATH_INFO: `/v3/users/438ac614bbd9493b893ee4f276322541` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:24.093915 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=438ac614bbd9493b893ee4f276322541)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:24.095836 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:24.278577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '438ac614bbd9493b893ee4f276322541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:24.290048 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:24.291200 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '438ac614bbd9493b893ee4f276322541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:24.298434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '438ac614bbd9493b893ee4f276322541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:24.350483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '438ac614bbd9493b893ee4f276322541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:24.351099 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '438ac614bbd9493b893ee4f276322541'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:24.357293 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1413/2819] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:24 2022] DELETE /identity/v3/users/438ac614bbd9493b893ee4f276322541 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:32:24.361906 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:24.363845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:24.363845 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:24.379684 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:24.380930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:24.438599 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1407/2820] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:24.448059 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:24.449476 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:24.506336 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44f0642-6a8d-42f0-ad84-fb8926e9b7ff admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:24.510301 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:24.510874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:24.511168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:24.511402 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:24.521545 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:24.522978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:24.535610 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1414/2821] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:24.895318 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:24.896773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:24.909600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b271a61-a6ff-4bc7-a829-b1a51b163071 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:24.914536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:24.915477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:24.917192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:24.917192 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] PATH_INFO: `/v3/projects/954d0c0c45f2433faa9beb09029fe7d0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:24.917452 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=954d0c0c45f2433faa9beb09029fe7d0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:24.919213 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:24.927975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:25.013118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954d0c0c45f2433faa9beb09029fe7d0', 'request_id': 'req-90f17d55-5972-46b3-bedc-2c9b6d8434ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.019841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954d0c0c45f2433faa9beb09029fe7d0', 'request_id': 'req-90f17d55-5972-46b3-bedc-2c9b6d8434ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.087361 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954d0c0c45f2433faa9beb09029fe7d0', 'request_id': 'req-90f17d55-5972-46b3-bedc-2c9b6d8434ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.097575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] The token cache is being invalidate because project 954d0c0c45f2433faa9beb09029fe7d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:25.097863 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.098477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.100013 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1408/2822] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:24 2022] DELETE /identity/v3/projects/954d0c0c45f2433faa9beb09029fe7d0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:25.104131 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:25.114134 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef521cb-260a-4f1a-a944-46d291b66c1e service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:25.167801 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:25.168692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:25.168973 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:25.169251 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] PATH_INFO: `/v3/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:25.170419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfb2cd4b2fa4f5f9d8ef16052f04c55)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:25.172845 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:25.311697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfb2cd4b2fa4f5f9d8ef16052f04c55'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.326840 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfb2cd4b2fa4f5f9d8ef16052f04c55'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.334498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfb2cd4b2fa4f5f9d8ef16052f04c55'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.372970 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfb2cd4b2fa4f5f9d8ef16052f04c55'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.373523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-abea07a6-64e1-4948-904a-1d6adc1122c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfb2cd4b2fa4f5f9d8ef16052f04c55'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.380065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1415/2823] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:25 2022] DELETE /identity/v3/users/3bfb2cd4b2fa4f5f9d8ef16052f04c55 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:25.808779 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:25.810337 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:25.826290 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f17d55-5972-46b3-bedc-2c9b6d8434ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:25.884007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:25.884814 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:25.885110 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:25.885388 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] PATH_INFO: `/v3/projects/b3c22d06923e4a44932ba878b95f70dc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:25.886562 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c22d06923e4a44932ba878b95f70dc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:25.888507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:25.989762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c22d06923e4a44932ba878b95f70dc', 'request_id': 'req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:25.996007 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c22d06923e4a44932ba878b95f70dc', 'request_id': 'req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:26.041746 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c22d06923e4a44932ba878b95f70dc', 'request_id': 'req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:26.052205 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] The token cache is being invalidate because project b3c22d06923e4a44932ba878b95f70dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:26.052496 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:26.053137 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2aaa887-09d9-42cc-81dc-8cfe0a8809a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:26.055103 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1409/2824] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:25 2022] DELETE /identity/v3/projects/b3c22d06923e4a44932ba878b95f70dc => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:26.059832 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.060148 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.060427 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.066802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:26.079338 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:26.080575 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:26.138630 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1416/2825] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:26.146750 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.147042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.147352 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.166123 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:26.167309 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:26.175413 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1410/2826] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:26.179422 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.189459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9450a8b9-dc65-4e98-9739-bbd4c37d9f3f None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.194013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.194657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.194943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.195217 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.196372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:26.196681 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.198257 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.210415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1417/2827] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:26.214480 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.223850 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cf840-50a9-44dd-8277-3c2c9c46d32f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.228536 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.229207 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.229490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.229768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.230459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.232408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.304999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:26.312905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1411/2828] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/projects => generated 401 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:26.316917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.326738 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667b9ca-42e5-481a-8b01-1daa99cb4aee admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.382314 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.382984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.383270 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.383549 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.384277 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.386181 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.459914 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1418/2829] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:26.463983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.474179 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0135f-8afe-498f-af5c-a120b918e15a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.478767 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.479418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.479704 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.479982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.480809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.482409 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.492947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1412/2830] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:26.497049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.507705 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7a2ab9-e329-4d68-8f6e-9acf4d931e6f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.512588 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.513303 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.513621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.514012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.514785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.517002 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e6c5fc-3015-4886-9c04-7ac7a3c963de admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.527241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1419/2831] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:26.531418 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.541947 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c4fe9-c390-4ae2-bb2d-7c68b8cd4b76 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.547095 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.547989 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.552465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.552465 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] PATH_INFO: `/v3/projects/71280f5ce46e44bdba3db00e8c40778b/users/173d7b4c7e4148c990c59c21da7638a3/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.563518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=71280f5ce46e44bdba3db00e8c40778b, user_id=173d7b4c7e4148c990c59c21da7638a3, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.566157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.635655 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1413/2832] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:26 2022] PUT /identity/v3/projects/71280f5ce46e44bdba3db00e8c40778b/users/173d7b4c7e4148c990c59c21da7638a3/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:26.646982 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.647298 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.647582 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.674615 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] MFA Rules not processed for user `173d7b4c7e4148c990c59c21da7638a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:26.675835 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:26.732711 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:26.738302 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1420/2833] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:26.743915 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.812898 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02c125-793b-4af2-8145-de57700b45ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.817296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.818031 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.818391 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.819200 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.820514 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.822014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:26.889838 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1414/2834] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/projects => generated 401 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:26.893737 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:26.904997 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f25873-2be7-4b99-a423-770135f6db11 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:26.964643 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:26.965373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:26.965663 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:26.965946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:26.966673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:26.969146 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.031976 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1421/2835] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:26 2022] POST /identity/v3/users => generated 307 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:27.035987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.047456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cec35a-0135-45fb-8fa8-959b1b9b43c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.052052 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.052737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.053024 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.053299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.054033 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.055611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.066026 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1415/2836] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:27.069984 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.079788 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ee5dac-aba0-4564-9268-4586093f7a3a admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.084342 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.085212 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.085493 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.085766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] PATH_INFO: `/v3/projects/77de9115e2ac4b29b84d1411fddec32c/users/719e7541f3784c1b9625e30165a18881/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.100503 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77de9115e2ac4b29b84d1411fddec32c, user_id=719e7541f3784c1b9625e30165a18881, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.103105 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.173676 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1422/2837] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:27 2022] PUT /identity/v3/projects/77de9115e2ac4b29b84d1411fddec32c/users/719e7541f3784c1b9625e30165a18881/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:27.177476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.187360 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d6cb1-652e-426b-97d4-6d1034da8c1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.242072 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.242736 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.243022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.243301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.244020 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.245645 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc6b34-513a-4d7c-b633-cae190a48638 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.255106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1416/2838] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:27 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:27.259153 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.269286 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b2356-4389-47c9-90e4-8da98b646627 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.273799 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.274679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.274956 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.275230 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] PATH_INFO: `/v3/projects/77de9115e2ac4b29b84d1411fddec32c/users/719e7541f3784c1b9625e30165a18881/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.277187 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77de9115e2ac4b29b84d1411fddec32c, user_id=719e7541f3784c1b9625e30165a18881, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.279834 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.290459 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1423/2839] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:27 2022] PUT /identity/v3/projects/77de9115e2ac4b29b84d1411fddec32c/users/719e7541f3784c1b9625e30165a18881/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:27.300839 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.301133 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.301414 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.327025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] MFA Rules not processed for user `719e7541f3784c1b9625e30165a18881`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:27.328786 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:27.348759 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:27.395101 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1417/2840] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:27.406510 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.408174 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:27.466255 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64dad8-cc90-454f-83c9-186317239f7d admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.470523 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.471167 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.471451 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.471728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.480591 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.482017 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.491274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1424/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 18:32:27.694504 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:27.704638 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552282dc-0b0e-429e-9052-610bd20e68d8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:27.708106 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:27.708761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:27.709042 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:27.709314 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:27.764321 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:27.766348 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac7ed1-b7e7-412b-99d1-e24b24f3ccc2 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:27.775010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1418/2842] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:32.662537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:32.712728 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:32.723592 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed3ee3-7704-4198-b587-555ce143689a service cinder] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:32.728300 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:32.729161 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:32.729449 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:32.729726 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] PATH_INFO: `/v3/users/173d7b4c7e4148c990c59c21da7638a3` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:32.730917 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173d7b4c7e4148c990c59c21da7638a3)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:32.732881 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:32.912406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173d7b4c7e4148c990c59c21da7638a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:32.924537 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173d7b4c7e4148c990c59c21da7638a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:32.931168 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173d7b4c7e4148c990c59c21da7638a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:32.995798 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173d7b4c7e4148c990c59c21da7638a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:32.996447 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173d7b4c7e4148c990c59c21da7638a3'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.003065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1425/2843] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:32 2022] DELETE /identity/v3/users/173d7b4c7e4148c990c59c21da7638a3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 18:32:33.007602 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:33.009447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:33.009447 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:33.025728 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:33.026913 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:33.083458 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1419/2844] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:33.092950 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:33.094339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:33.152746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44f20b-9a98-4351-a969-79ca5470f070 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:33.156554 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:33.157197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:33.157483 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:33.157765 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:33.166911 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:33.168299 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:33.177589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1426/2845] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:33.666459 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:33.672461 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:33.681167 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa05c0e-9e52-49c2-b472-d5d04ff3a5f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:33.685907 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:33.686803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:33.687094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:33.687372 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] PATH_INFO: `/v3/projects/71280f5ce46e44bdba3db00e8c40778b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:33.688610 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71280f5ce46e44bdba3db00e8c40778b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:33.690557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:33.796071 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71280f5ce46e44bdba3db00e8c40778b', 'request_id': 'req-f7b012da-9699-49c9-9633-c57bbec737c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.798627 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:33.802914 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71280f5ce46e44bdba3db00e8c40778b', 'request_id': 'req-f7b012da-9699-49c9-9633-c57bbec737c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.887678 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71280f5ce46e44bdba3db00e8c40778b', 'request_id': 'req-f7b012da-9699-49c9-9633-c57bbec737c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.898277 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] The token cache is being invalidate because project 71280f5ce46e44bdba3db00e8c40778b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:33.898565 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.899187 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:33.900776 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1420/2846] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:33 2022] DELETE /identity/v3/projects/71280f5ce46e44bdba3db00e8c40778b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:33.904733 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:33.914916 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcb995-c9ee-4264-93a7-a6814003e109 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:33.970907 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:33.971693 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:33.971979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:33.972288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] PATH_INFO: `/v3/users/719e7541f3784c1b9625e30165a18881` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:33.973457 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=719e7541f3784c1b9625e30165a18881)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:33.975364 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:33.991122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:34.145952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719e7541f3784c1b9625e30165a18881'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.158123 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719e7541f3784c1b9625e30165a18881'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.165001 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719e7541f3784c1b9625e30165a18881'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.212819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719e7541f3784c1b9625e30165a18881'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.213424 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-666ae3ec-817b-480e-a64c-fc962e3a70d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719e7541f3784c1b9625e30165a18881'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.220000 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1427/2847] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:33 2022] DELETE /identity/v3/users/719e7541f3784c1b9625e30165a18881 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:34.605186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:34.606696 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:34.623557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b012da-9699-49c9-9633-c57bbec737c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:34.680090 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:34.680975 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:34.681259 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:34.681533 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] PATH_INFO: `/v3/projects/77de9115e2ac4b29b84d1411fddec32c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:34.682686 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77de9115e2ac4b29b84d1411fddec32c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:34.684620 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:34.767815 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77de9115e2ac4b29b84d1411fddec32c', 'request_id': 'req-4adabb2b-e0b5-473e-b5c1-0126c516e939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.773760 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77de9115e2ac4b29b84d1411fddec32c', 'request_id': 'req-4adabb2b-e0b5-473e-b5c1-0126c516e939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.841826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77de9115e2ac4b29b84d1411fddec32c', 'request_id': 'req-4adabb2b-e0b5-473e-b5c1-0126c516e939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.852575 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] The token cache is being invalidate because project 77de9115e2ac4b29b84d1411fddec32c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:34.853448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.854084 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4adabb2b-e0b5-473e-b5c1-0126c516e939 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:34.855626 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1421/2848] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:34 2022] DELETE /identity/v3/projects/77de9115e2ac4b29b84d1411fddec32c => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:34.860995 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:34.861288 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:34.861570 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:34.879415 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:34.880657 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:34.940239 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1428/2849] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:34.948100 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:34.948423 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:34.948780 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:34.966713 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:34.967899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:34.975737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1422/2850] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:34.979706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:34.989672 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f7dd3-00e0-44f4-84d4-7a150ef8aa8a None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:34.994120 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:34.994766 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:34.995049 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:34.995324 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:34.996050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:34.996384 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:34.997967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.009838 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1429/2851] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:35.013827 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.022797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45af917d-9a23-44d3-bff5-051351e48dab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.027249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.027880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.028197 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.028477 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.029160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.031029 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.111717 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1423/2852] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:35 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:35.115671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.126244 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44063aa9-9c1d-4ce2-9738-b73409f7c864 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.181198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.181857 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.182141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.182418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.183097 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.185021 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.310965 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1430/2853] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:35 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:35.315181 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.325650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d32fc6-c709-4156-ac48-8204a6ee71cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.330241 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.330896 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.331183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.331462 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.332226 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.333826 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.344608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1424/2854] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:35.348435 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.358258 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ffb6bd-4cd3-4171-b6b4-e617436ca5cf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.363518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.364195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.364498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.364758 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.365518 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.367088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1096f16-3189-48ac-b594-3e30e97b8d83 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.372234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:35.377925 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1431/2855] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:35.382164 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.391961 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ff36f-90bd-4fa2-a2cc-2dd16e357600 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.396529 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.397390 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.397672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.397945 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] PATH_INFO: `/v3/projects/9fff95a9b771482d82dd13d43d81d11e/users/009a16ed84d342b8a38fff10baae7cd4/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.412628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fff95a9b771482d82dd13d43d81d11e, user_id=009a16ed84d342b8a38fff10baae7cd4, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.415513 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.488328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1425/2856] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:35 2022] PUT /identity/v3/projects/9fff95a9b771482d82dd13d43d81d11e/users/009a16ed84d342b8a38fff10baae7cd4/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:35.552312 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.552605 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.552891 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.579241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] MFA Rules not processed for user `009a16ed84d342b8a38fff10baae7cd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:35.580406 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:35.642853 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1432/2857] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:35.647323 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.656820 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:35.708931 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ccc5d-3ca9-49c1-95c0-d2b72be3f06b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.713591 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.714238 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.714539 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.714794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.715482 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.717405 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.816714 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1426/2858] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:35 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:35.817975 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:35.829216 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289c1c7-44bb-40ef-9ce4-a34086d07e97 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:35.885598 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:35.886192 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:35.886477 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:35.886749 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:35.887425 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:35.889337 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:35.990197 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1433/2859] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:35 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:35.994196 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:36.004990 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b6b2a-22a8-4056-88a3-b6b0b1bf9219 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:36.009556 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:36.010199 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.010479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.010755 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.011476 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:36.013094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:36.025082 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1427/2860] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:36.028963 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:36.039054 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17423e34-d9c4-4149-918f-ecd62671852f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:36.043673 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:36.044577 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.044865 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.045144 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] PATH_INFO: `/v3/projects/06e5a0527bfd453a8dddd1ecac546718/users/a9c523b5dcc243fdabc2d0d0abf675a2/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.059472 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e5a0527bfd453a8dddd1ecac546718, user_id=a9c523b5dcc243fdabc2d0d0abf675a2, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:36.062155 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:36.127458 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1434/2861] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:36 2022] PUT /identity/v3/projects/06e5a0527bfd453a8dddd1ecac546718/users/a9c523b5dcc243fdabc2d0d0abf675a2/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:36.131474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:36.142120 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d183866-03d2-4814-8497-2827a0253d9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:36.197044 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:36.197707 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.197991 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.198269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.198987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:36.200611 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246b27c-02f4-45ce-8032-dc4998929981 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:36.210481 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1428/2862] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:32:36.214715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:36.225428 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b870e-a200-4db2-9ddc-3386e7587e1b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:36.229940 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:36.230819 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.231101 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.231376 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] PATH_INFO: `/v3/projects/06e5a0527bfd453a8dddd1ecac546718/users/a9c523b5dcc243fdabc2d0d0abf675a2/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.233485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e5a0527bfd453a8dddd1ecac546718, user_id=a9c523b5dcc243fdabc2d0d0abf675a2, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:36.236782 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:36.246846 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1435/2863] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:36 2022] PUT /identity/v3/projects/06e5a0527bfd453a8dddd1ecac546718/users/a9c523b5dcc243fdabc2d0d0abf675a2/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:36.256797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.257085 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.257362 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.283664 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] MFA Rules not processed for user `a9c523b5dcc243fdabc2d0d0abf675a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:36.284900 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:36.351018 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1429/2864] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:36.361706 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:36.363400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:36.408559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:36.419874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7202-1859-4639-9203-24d85c117628 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:36.423624 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:36.435235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:36.435235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:36.435235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:36.435235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:36.435235 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89789ad-bc1b-4243-a02b-76d3a8a90d17 service cinder] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:36.444697 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1436/2865] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:37.485854 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:37.489987 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:37.548109 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933273c-14dd-4a6e-9b95-6123ca774696 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:37.552666 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:37.553532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:37.553841 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:37.554118 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] PATH_INFO: `/v3/users/009a16ed84d342b8a38fff10baae7cd4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:37.555342 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=009a16ed84d342b8a38fff10baae7cd4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:37.557358 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:37.723631 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009a16ed84d342b8a38fff10baae7cd4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:37.735628 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009a16ed84d342b8a38fff10baae7cd4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:37.742647 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009a16ed84d342b8a38fff10baae7cd4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:37.807202 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009a16ed84d342b8a38fff10baae7cd4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:37.807844 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009a16ed84d342b8a38fff10baae7cd4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:37.814257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1430/2866] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:37 2022] DELETE /identity/v3/users/009a16ed84d342b8a38fff10baae7cd4 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:37.818869 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:37.819368 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:37.819485 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:37.837528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:37.838723 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:37.895429 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1437/2867] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:37.904994 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:37.907025 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:37.962721 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf337ac-b688-4ddd-8a0b-530a6bd395f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:37.966347 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:37.966992 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:37.967276 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:37.967552 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:37.977968 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:37.979371 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:37.989918 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1431/2868] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:38.374634 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:38.381908 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:38.391351 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0f11d-376f-46f0-888b-f536ea10754e None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:38.396198 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:38.397214 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:38.397506 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:38.397785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] PATH_INFO: `/v3/projects/9fff95a9b771482d82dd13d43d81d11e` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:38.399074 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fff95a9b771482d82dd13d43d81d11e)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:38.401326 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:38.510330 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fff95a9b771482d82dd13d43d81d11e', 'request_id': 'req-02153511-6224-4aba-ba8b-5c69004a8e9f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.516988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fff95a9b771482d82dd13d43d81d11e', 'request_id': 'req-02153511-6224-4aba-ba8b-5c69004a8e9f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.584646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fff95a9b771482d82dd13d43d81d11e', 'request_id': 'req-02153511-6224-4aba-ba8b-5c69004a8e9f'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.595088 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] The token cache is being invalidate because project 9fff95a9b771482d82dd13d43d81d11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:38.595372 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.595989 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.597572 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1438/2869] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:38 2022] DELETE /identity/v3/projects/9fff95a9b771482d82dd13d43d81d11e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:38.601508 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:38.611829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4e1b2-04cd-475d-896c-52c4db51d3c8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:38.635254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:38.676392 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:38.677262 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:38.677553 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:38.678595 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] PATH_INFO: `/v3/users/a9c523b5dcc243fdabc2d0d0abf675a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:38.679789 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9c523b5dcc243fdabc2d0d0abf675a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:38.681803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:38.872149 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9c523b5dcc243fdabc2d0d0abf675a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.883685 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9c523b5dcc243fdabc2d0d0abf675a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.890976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9c523b5dcc243fdabc2d0d0abf675a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.956138 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9c523b5dcc243fdabc2d0d0abf675a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.956793 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-156a2a08-e1bf-472e-a184-aeb4de2f2e13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9c523b5dcc243fdabc2d0d0abf675a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:38.963228 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1432/2870] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:38 2022] DELETE /identity/v3/users/a9c523b5dcc243fdabc2d0d0abf675a2 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:39.375413 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:39.377003 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:39.390436 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02153511-6224-4aba-ba8b-5c69004a8e9f admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:39.447492 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:39.448400 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:39.448686 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:39.448966 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] PATH_INFO: `/v3/projects/06e5a0527bfd453a8dddd1ecac546718` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:39.450150 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e5a0527bfd453a8dddd1ecac546718)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:39.452173 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:39.462308 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:39.579407 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e5a0527bfd453a8dddd1ecac546718', 'request_id': 'req-4c20e2f2-5821-4cd1-ab45-0effa59a711b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:39.585611 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e5a0527bfd453a8dddd1ecac546718', 'request_id': 'req-4c20e2f2-5821-4cd1-ab45-0effa59a711b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:39.647602 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e5a0527bfd453a8dddd1ecac546718', 'request_id': 'req-4c20e2f2-5821-4cd1-ab45-0effa59a711b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:39.659175 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] The token cache is being invalidate because project 06e5a0527bfd453a8dddd1ecac546718 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80582) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:39.659464 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:39.660090 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-4c20e2f2-5821-4cd1-ab45-0effa59a711b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:39.661651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1439/2871] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:39 2022] DELETE /identity/v3/projects/06e5a0527bfd453a8dddd1ecac546718 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:39.667209 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:39.667706 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:39.667824 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:39.685765 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:39.686983 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:39.743942 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1433/2872] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:39.752753 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:39.753122 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:39.753404 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:39.771419 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:39.772714 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:39.780531 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1440/2873] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:39.785299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:39.795326 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a334d-f89c-4728-973f-93273128ba40 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:39.800761 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:39.801417 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:39.801702 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:39.801976 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:39.802701 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:39.803010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:39.804650 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:39.821183 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1434/2874] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:39.825478 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:39.835339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3ccfd-92d6-442b-b359-c72246611ca0 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:39.839967 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:39.840654 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:39.840937 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:39.841213 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:39.841935 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:39.844426 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:39.929622 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1441/2875] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:39 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:39.933799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:39.944158 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eee620-b175-4835-89ce-4b9484f70a8b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:39.975727 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:40.008328 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.008999 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.009292 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.009571 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.010257 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.012198 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.099445 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1435/2876] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:39 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:40.103525 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.114282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93ac325-fe73-4e35-8142-779fd0d511e3 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.119050 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.119722 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.120012 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.120322 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.121087 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.122678 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.133227 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1442/2877] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 18:32:40.137881 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.148507 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad80cf-d24d-49fe-97e1-a5c0953ebc1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.153171 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.153832 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.154145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.154446 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.155178 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.157439 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58a4ba-031d-4a2d-a0a2-2f8047f7bfdc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.168516 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1436/2878] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:40.172651 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.182805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e98bf-5741-44ca-85db-96e26310a89b admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.187275 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.188182 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.188468 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.188743 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] PATH_INFO: `/v3/projects/ee855ee45170408ea2ef98beba0d4bef/users/6934808ffffa4a1ca0886e20cd72d59b/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.203688 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee855ee45170408ea2ef98beba0d4bef, user_id=6934808ffffa4a1ca0886e20cd72d59b, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.206390 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.288229 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1443/2879] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:40 2022] PUT /identity/v3/projects/ee855ee45170408ea2ef98beba0d4bef/users/6934808ffffa4a1ca0886e20cd72d59b/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:40.298905 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.299194 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.299479 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.326715 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] MFA Rules not processed for user `6934808ffffa4a1ca0886e20cd72d59b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:40.328927 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:40.396253 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1437/2880] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:40.400978 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.463527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a50d4-f97b-454d-9e4f-b460ec9552cf admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.468052 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.468779 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.469062 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.469339 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.470029 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.471929 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.523282 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1444/2881] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:40 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:40.527221 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.538126 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84fc562-605f-4adf-9746-b8759b322173 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.593295 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.593965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.594256 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.594538 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.595268 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.597227 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.670470 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1438/2882] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:40 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:40.674498 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.685315 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ff583-6b17-4e59-9743-25a13ec34351 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.690565 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.691234 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.691527 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.691812 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.692581 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.694186 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.706195 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1445/2883] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:40.710234 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.720260 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f909299-e655-4b3c-b9f4-70ddc10fbbae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.724772 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.725644 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.725929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.726206 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] PATH_INFO: `/v3/projects/a74ae338190842ea839233c2c8654947/users/8bc0eb849b794292baca8c70a796ba35/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.740675 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ae338190842ea839233c2c8654947, user_id=8bc0eb849b794292baca8c70a796ba35, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.743296 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.819672 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1439/2884] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:40 2022] PUT /identity/v3/projects/a74ae338190842ea839233c2c8654947/users/8bc0eb849b794292baca8c70a796ba35/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:40.823514 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.833637 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0efb2a-1037-4af8-957a-0341fcba4fbd admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.838224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:40.888532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.889203 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.889494 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.889778 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.890528 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.892152 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214063df-af77-4992-ae56-e9587d65b809 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.902434 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1446/2885] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:40.906492 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:40.913094 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:40.917216 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd578de4-4ebd-49eb-b46b-ca9db9e57d6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:40.922301 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:40.923165 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.923448 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.923722 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] PATH_INFO: `/v3/projects/a74ae338190842ea839233c2c8654947/users/8bc0eb849b794292baca8c70a796ba35/roles/7d08fb98b09c4c7c80af084a6709b7cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.925809 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a74ae338190842ea839233c2c8654947, user_id=8bc0eb849b794292baca8c70a796ba35, role_id=7d08fb98b09c4c7c80af084a6709b7cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:40.928501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:40.950160 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1440/2886] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:40 2022] PUT /identity/v3/projects/a74ae338190842ea839233c2c8654947/users/8bc0eb849b794292baca8c70a796ba35/roles/7d08fb98b09c4c7c80af084a6709b7cb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:40.960858 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:40.961445 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:40.961952 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:40.989418 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] MFA Rules not processed for user `8bc0eb849b794292baca8c70a796ba35`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:40.990661 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:41.058399 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1447/2887] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:41.069444 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:41.071134 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:41.126747 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c855a8b4-e680-4018-bb3e-5fdc3cc9eff2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:41.130532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:41.131169 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:41.131453 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:41.131735 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:41.140734 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:41.142279 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717384-411a-4e39-ab01-0c526f2b0d1e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:41.151608 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1441/2888] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:41.620333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:41.680979 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d69d3-ddde-4678-902e-37e30ef5c598 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:41.685430 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:41.686385 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:41.686671 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:41.686948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] PATH_INFO: `/v3/users/6934808ffffa4a1ca0886e20cd72d59b` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:41.688127 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6934808ffffa4a1ca0886e20cd72d59b)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:41.690065 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:41.895100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:41.906692 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6934808ffffa4a1ca0886e20cd72d59b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:41.918784 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6934808ffffa4a1ca0886e20cd72d59b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:41.925455 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6934808ffffa4a1ca0886e20cd72d59b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:41.984106 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6934808ffffa4a1ca0886e20cd72d59b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:41.984750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6934808ffffa4a1ca0886e20cd72d59b'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:41.990930 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1448/2889] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:41 2022] DELETE /identity/v3/users/6934808ffffa4a1ca0886e20cd72d59b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:41.995600 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:41.996091 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:41.996232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:42.014089 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:42.015274 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:42.076077 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1442/2890] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:42.086383 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:42.087750 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:42.145291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67b08-1f95-405e-9d0c-ddd00c47ee45 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:42.149013 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:42.149653 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:42.149944 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:42.150224 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:42.159205 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:42.160669 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:42.170361 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1449/2891] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:42.615014 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:42.617799 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:42.629022 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fc5ae-793e-4447-8745-c34132a4db42 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:42.633583 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:42.634474 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:42.635203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:42.635203 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] PATH_INFO: `/v3/projects/ee855ee45170408ea2ef98beba0d4bef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:42.636523 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee855ee45170408ea2ef98beba0d4bef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:42.638518 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:42.749948 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee855ee45170408ea2ef98beba0d4bef', 'request_id': 'req-43a90e84-f55d-4fc4-a4ca-02203a32b329'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:42.755979 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee855ee45170408ea2ef98beba0d4bef', 'request_id': 'req-43a90e84-f55d-4fc4-a4ca-02203a32b329'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:42.818794 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee855ee45170408ea2ef98beba0d4bef', 'request_id': 'req-43a90e84-f55d-4fc4-a4ca-02203a32b329'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:42.829532 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] The token cache is being invalidate because project ee855ee45170408ea2ef98beba0d4bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:42.833525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:42.833525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:42.833525 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1443/2892] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:42 2022] DELETE /identity/v3/projects/ee855ee45170408ea2ef98beba0d4bef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:42.836089 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:42.846283 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ef1b3-1d73-4ea1-97de-a794613e3cb7 service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:42.901307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:42.902100 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:42.902382 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:42.902700 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] PATH_INFO: `/v3/users/8bc0eb849b794292baca8c70a796ba35` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:42.903874 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc0eb849b794292baca8c70a796ba35)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:42.905805 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:43.076894 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc0eb849b794292baca8c70a796ba35'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.082532 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:43.089215 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc0eb849b794292baca8c70a796ba35'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.096536 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc0eb849b794292baca8c70a796ba35'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.178465 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc0eb849b794292baca8c70a796ba35'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.178999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-b75dc73b-378e-46e0-b6a7-7bc60fa6295c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc0eb849b794292baca8c70a796ba35'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.185290 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1450/2893] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:42 2022] DELETE /identity/v3/users/8bc0eb849b794292baca8c70a796ba35 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:43.585929 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:43.587375 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:43.601081 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90e84-f55d-4fc4-a4ca-02203a32b329 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:43.614534 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:43.657803 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:43.658732 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:43.658993 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:43.659269 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] PATH_INFO: `/v3/projects/a74ae338190842ea839233c2c8654947` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:43.660472 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a74ae338190842ea839233c2c8654947)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:43.662501 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:43.754930 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a74ae338190842ea839233c2c8654947', 'request_id': 'req-aceecd08-1059-4532-995d-9cd10ec13e5b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.760837 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a74ae338190842ea839233c2c8654947', 'request_id': 'req-aceecd08-1059-4532-995d-9cd10ec13e5b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.835744 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a74ae338190842ea839233c2c8654947', 'request_id': 'req-aceecd08-1059-4532-995d-9cd10ec13e5b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.846949 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] The token cache is being invalidate because project a74ae338190842ea839233c2c8654947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:43.847232 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.851299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aceecd08-1059-4532-995d-9cd10ec13e5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:43.851299 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1444/2894] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:43 2022] DELETE /identity/v3/projects/a74ae338190842ea839233c2c8654947 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:43.854341 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:43.854827 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:43.854943 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:43.872597 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:43.873802 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:43.931228 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1451/2895] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:43.940006 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5807db-3568-4484-bc85-7332efdce877 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:43.940334 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5807db-3568-4484-bc85-7332efdce877 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:43.940630 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5807db-3568-4484-bc85-7332efdce877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:43.959456 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be5807db-3568-4484-bc85-7332efdce877 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:43.960797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be5807db-3568-4484-bc85-7332efdce877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:43.968762 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1445/2896] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:43.973715 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:43.983328 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c69f6-f62f-4c7e-93a7-1d7653a8f149 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:43.987900 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:43.988589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:43.988877 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:43.989159 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:43.989890 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80582) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 18:32:43.990204 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:43.991794 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.003067 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1452/2897] 10.222.0.33 () {58 vars in 1152 bytes} [Tue Jul 12 18:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 18:32:44.007128 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5807db-3568-4484-bc85-7332efdce877 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.016825 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5807db-3568-4484-bc85-7332efdce877 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.021548 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.022184 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.022469 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.022745 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.023425 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.025345 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.105557 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1446/2898] 10.222.0.33 () {60 vars in 1152 bytes} [Tue Jul 12 18:32:44 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 18:32:44.109626 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.119679 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00d81b-a261-432e-a32f-67e60561f7c8 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.175118 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.175785 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.176072 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.176380 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.177082 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.178987 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.265112 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1453/2899] 10.222.0.33 () {60 vars in 1143 bytes} [Tue Jul 12 18:32:44 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 18:32:44.269835 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.280087 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfb69e-2e1a-487e-afe3-f5e9ac283e49 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.284643 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.285291 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.285574 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.285843 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.286606 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.288223 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.298617 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1447/2900] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:44.302333 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.312291 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1c193-d22d-4774-8b52-0210f4aa3fc7 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.317307 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.317955 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.318237 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.318513 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.319249 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.320849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771e82e-10f2-4205-9632-7c4928eb4de4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.331760 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1454/2901] 10.222.0.33 () {58 vars in 1121 bytes} [Tue Jul 12 18:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 18:32:44.335567 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.345231 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582900b1-ffa2-4063-b754-513ffbd4fc9e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.349733 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.350588 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.350868 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.351144 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] PATH_INFO: `/v3/projects/ac2640f1a42644ab9790e30e9cf0902b/users/686f81bcc9aa42929d37f84277da6025/roles/a07daedde46245149312ec8c706e6fef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.365249 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac2640f1a42644ab9790e30e9cf0902b, user_id=686f81bcc9aa42929d37f84277da6025, role_id=a07daedde46245149312ec8c706e6fef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.367842 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.446846 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1448/2902] 10.222.0.33 () {60 vars in 1482 bytes} [Tue Jul 12 18:32:44 2022] PUT /identity/v3/projects/ac2640f1a42644ab9790e30e9cf0902b/users/686f81bcc9aa42929d37f84277da6025/roles/a07daedde46245149312ec8c706e6fef => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:44.457587 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] REQUEST_METHOD: `POST` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.457880 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.458164 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.484941 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.auth.core [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] MFA Rules not processed for user `686f81bcc9aa42929d37f84277da6025`. Rule list: `[]` (Enabled: `True`). {{(pid=80582) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:44.486142 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:44.511141 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:44.549946 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1455/2903] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:44.563186 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.565511 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:44.610880 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:44.621954 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bd852-1ec3-4e3a-bd0e-003f4aefed41 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.625829 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c342400998514fe5beb96566fba15918', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.626490 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.626773 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.627596 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.635768 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.637254 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee58dca2-1cf0-478f-886f-5d4c6b29cf7f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.646010 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1449/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:44.671071 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:44.733018 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b9dfe-0d88-4e01-8acc-add6f6be9e10 None None] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:44.738126 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:44.738988 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:44.739274 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:44.739550 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] PATH_INFO: `/v3/users/686f81bcc9aa42929d37f84277da6025` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:44.740761 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=686f81bcc9aa42929d37f84277da6025)` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:44.742665 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:44.905859 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '686f81bcc9aa42929d37f84277da6025'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:44.918826 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '686f81bcc9aa42929d37f84277da6025'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:44.926365 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '686f81bcc9aa42929d37f84277da6025'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:44.989360 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '686f81bcc9aa42929d37f84277da6025'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:44.990010 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.notifications [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '686f81bcc9aa42929d37f84277da6025'} {{(pid=80582) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:44.996248 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1456/2905] 10.222.0.33 () {58 vars in 1223 bytes} [Tue Jul 12 18:32:44 2022] DELETE /identity/v3/users/686f81bcc9aa42929d37f84277da6025 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:45.000797 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:45.001080 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:45.001366 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:45.018141 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] MFA Rules not processed for user `32e3d944938840afa028a580cf62f192`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 18:32:45.019364 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:45.076982 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1450/2906] 10.222.0.33 () {58 vars in 957 bytes} [Tue Jul 12 18:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 18:32:45.086373 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:45.087746 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:45.138786 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:45.144199 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891967c-d75f-456b-9a83-ca6cd1a80cf4 admin admin] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:45.147849 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f30afe81d08546e5b56ab490893ef303', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:45.148519 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:45.148841 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:45.149124 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:45.158713 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:45.160149 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:45.170646 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1457/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:32:45.591709 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:32:45.593157 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:32:45.608289 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc6498-8f3c-4569-ac6d-348e52f15023 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:32:45.617737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32e3d944938840afa028a580cf62f192', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '71b4b41640174f02914b235b985edf53', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:32:45.617737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:32:45.617737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:32:45.617737 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] PATH_INFO: `/v3/projects/ac2640f1a42644ab9790e30e9cf0902b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:32:45.618899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac2640f1a42644ab9790e30e9cf0902b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:32:45.618899 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:32:45.721965 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac2640f1a42644ab9790e30e9cf0902b', 'request_id': 'req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:45.728145 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac2640f1a42644ab9790e30e9cf0902b', 'request_id': 'req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:45.790011 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac2640f1a42644ab9790e30e9cf0902b', 'request_id': 'req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:45.800494 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] The token cache is being invalidate because project ac2640f1a42644ab9790e30e9cf0902b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 18:32:45.800785 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:45.801408 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7bf048be-8ebd-4291-b1c8-86e8608dd0ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 18:32:45.802956 dv-cinder-844881-1-smb devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1451/2908] 10.222.0.33 () {58 vars in 1232 bytes} [Tue Jul 12 18:32:45 2022] DELETE /identity/v3/projects/ac2640f1a42644ab9790e30e9cf0902b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 18:32:55.298334 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=5 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:32:55.797531 dv-cinder-844881-1-smb devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 18:34:19.682589 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] Authenticating user token {{(pid=80582) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 18:34:19.683992 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.759559 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d77cc-65c8-42a0-babf-09912e0890df service neutron] Validating token access rules against request {{(pid=80582) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 18:34:19.827893 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6bf6579be6b84cefb9bafe082cfa19f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa95e8be2704b38b0d147a42176e3ba', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80582) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 18:34:19.828658 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] REQUEST_METHOD: `GET` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 18:34:19.828948 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] SCRIPT_NAME: `/identity` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 18:34:19.829231 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80582) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 18:34:19.830999 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.fernet_utils [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80582) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 18:34:19.842633 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 18:34:19.844241 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc7b12-ffa1-49c8-8a34-07aa75cbea26 service placement] RBAC: Authorization granted {{(pid=80582) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 18:34:19.854621 dv-cinder-844881-1-smb devstack@keystone.service[80582]: [pid: 80582|app: 0|req: 1458/2909] 10.222.0.33 () {60 vars in 1365 bytes} [Tue Jul 12 18:34:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 18:34:29.850343 dv-cinder-844881-1-smb devstack@keystone.service[80582]: DEBUG dbcounter [-] [80582] Writing DB stats keystone:SELECT=58 {{(pid=80582) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}